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SUMMARY 

This  study  investigates  how  people  create  plans  to  accomplish  a  task  that  has 
both  ’.emporal  and  spatial  components..  The  study  h'ad  two  goals:  to  develop  a 
methoo  for  drterrnining  the  cognitive  processes- associated  with  planning;  and  to 
develop  4  model  for  efficient  planning  for  the  task  used  in  the  study,  two 
planners  gave  verbal  and  graphical,  protocols  while  planning  the  most  efficient 
way  for  shopping  robots  to  pick  up  commodities  in  a  grocery  store;  Each  planner 
created  a  plan  for  twelve  such  problems  and  the  plan  was  executed  after  each 
planning  session.  The  protocols  were  analyzed  to  identify  the  primitive  concepts 
and  actions  used  in  the  planning  process.  Observations  of  planners’  behavior  in 
this  study  indicated  that  plans  were  developed  in  an  evolutionary  manner. 
Planners  discovered  and  refined  methods  for  organizing  the  ih.formation  and 
procedures  for  manipulating  it  during  the  course  of  the  sessions.  Furthermore,  if 
was  shown  that  planners  attended  to  different  levels  of  detail  of  information  in 
planning,  and  used  a  variety  of  planning  strategies.  A  hierarchical  model  for 
efficient  planning  for  this  task  is  proposed  that  sssumes  plans  are  developed 
hierarchically  at  three  successive  levels  of  detaii.c;>-j 
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Cognitieve  processen  in'Coihmand  and  Control  planning.  3:  Basisprocessen’in 
planning  in  tyd  eh  hiimte 

CA  McCann  en  RJ.M.D.  Essens 
SAMENVATTING 

In  deze  studie  wordt  onderzocht  hoe  mensen  plannen  creeren  yoor  een  taak  die 
zowel  temporele  als  spatiele  componenien  bevat.  De  studie  had  twee  doelen:  het 
ontwikkelen  van  een  methode  voor  het  bepalen  van.  de  cognitieye  processen  die 
met  planning  samenhangen  en  het  ontwikkelen  van  een  model  voor  efficiente 
planning  voor  de  taak  gebruikt  in  deze  studie.  Twee  planners  gaven  verbale  en 
grafische  protocollen  terwijl  ze  een  planning  maakten  voor  de  meest  effi-ciente 
weg  voor  winkel-robots  pm  goederen  op  te  halen  in  een  winkel.  Voor  twaalf  van 
deze  planningsprobleihen  creeerde  elke  planner  een  plan  en  dit  plan  werd 
uitgevoerd  na  elke  planningssesde.  De  prbtbcolien  werdeti  geanalyseerd  6m  de 
primitieve  cohcepten  en  acties  te  identificeren  die  gebruikt'  werdeii  tijdens  het 
planmngsproces.  Geobserveerd  werd,  dat  plannen  dp  eyblutidnaire  wijz'e  werden 
ontwikkeld.  Tijdens 'het  verloop  van  de  sdssies  oritdekten  eri  yerfijnden,  planners 
methoderi  eri  procedures  voor  het  organiseren  en  riiariipu|eren  van  de  infprma- 
tie.  Verder  werd  gevorideri  dat  planners  een  verscheidenheid  aan  strategieen 
gebru'ikten  en  aandacht  gaven  aan  yerschillende  niveaus  van  detail  van  infd'rma- 
tle  in  de  planning.  Eeri  hiSrarchisch  model  voor  efficiente  planning  voor  deze 
taak  v.'rirdt  gepresenteerd  dat  ervan.uitgaat  dat  plarinpri  hierarchisch  ontwikkeld 
wovden  op  drie  opeenvolgepde  niveaus  van  detaij. 
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1  INTROpycnON 

The..creatiqn.of;plans-  concerning,  the  use  of;  resources , to  accomplish  tasks  in  a 
spatial  environment  is  paramount  for  successful  command,  andi  control  .opera¬ 
tions.  Yet  relatively  little  is  known  about  how  humans  plan  these  kinds  of  tasks; 
there  .have  been,  few  empirical  studies  investigating;  .this  issue  (McCaim,  <1990). 
Tliis  lack  of  fondamental  knojyledge  about  the  cognitive  processes  used  1 
people  .in  creating  .plans  to  be  executed  in  time  and!  space,  inust  be. addressed  ii 
we ,  are  to  .be  succdsful  in  building  computerrbased  systems  for  assisting  military 
planmrig,  ,  ,  •  ,  , 

A  plan  is.a^representatipn  of  a  course  of.actipn,  •usuaHy.,given',as  an  ordered  set 
of  goals. (Cohen.  &  Feigpnbaum,  1982)..  For  the  plan  to  be  executed  in  the  real 
syprld,  the  goals  must  .be,  interpretable  as -operations  .that.  can.be  carried  put  in 
that  world;  For  example}  a  military,  plan,  might  consist  of.  the  ordered  goals: 
"capture  this  bridge,  while  defending,  this  ;piece  of  grpund;  then  cross  the  river 
and  seize  this  .enemy  position".  This  plan  .can  be  carried  put  if  the  executing  units 
understand  the  meaning  pf  the  operators  "capture",  "defend",  "cross"  and.  "seize". 
The  plan.  itself  can  be  considered  to  be  a-hierarch|cal- structure  that  consists  of 
nested  subgpals,  "Crossing  the  river"  in  the  example  might  require  .first  that  the 
bridge  be  checked  for  damage  and.  repaired  if  necessary,  then  that  the  individual 
military  units  cross  in  a  certain  order. 

The  process  of  planning  is  basically  a  search  for  the  ordering  of  the  operators 
that  will  achieve  the  primary  goal.  Processes  for  planning  have  been  most 
extensively  studied  in  the  field  of  artificial  intelligence,  where  a  particular 
approach  to  planning,  called  the  hierarchical  approach,  was  developed.  In 
hierarchical  ptannlng,.,a  rough  (vague)  plan  is  developed  first  and  . then  the  rough 
parts  are  refined  into  detailed  subplans  and  hence  into  a  sequence  of  defined 
operators.  The  key  characteristic  of  this  approach  is  that  it  uses  a  hierarchy  of 
plan  representations  during  the  planning  process  itself  This  has  the  advantage 
that  the  details  of  plaaning  do  not  become  computationally  overvyhelming.  This 
modcLhte  been  extensively  refined^  but  .is  not  based  on  evidence  front  studies  of 
human  planning. 

Hayes-Roth ,  and  Hayes-Roth  (1979).  have  argued  tfiat  a  strict  tpp-to-bottom, 
coarse-tQ-fine  approach  to  plan  development  is  not  characteristic  of  human 
planning.  They  based  their  conclusions,  oh.  the  analysis  of  humans  solving  a 
practical  errand  problem.  The  cognitive  rnodel  of  planning  resulting  from,  this 
work,  called  the  "opportunistic  model",  proposes  that  humans  plan  via  a  multidi¬ 
rectional  movement  through  a  set  of  decision  categories  and  observations  that 
ipfluence  the  plan  development.  Although  the  idea  of  different  levels,  of  plan 
abstraction  is  maintained  in  the  m.pdel,  the  movement  through  these  levels  is-not 
strictly  top-down  from  development  of  an  abstract  to  development  of  a  , detailed 
plan,  as  it  1?  in  hierarchical  planning.  It  can  have  a  strong  bottom-up  component: 
dedsiotis  about  plan  steps  are  influenced  . by  immediately-obtainable  goals  (e.g., 
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"convenience")  that  seem  to  be  brought  into  focus  by  plan  simuiation;  In  general, 
planning  is  "opportunistic":  planning  processes  are  instigated  by  something  that 
the  planner  notices  about  the  state  of  the  world  ^  it  is  transformed 'ffirough 
simulation  of  the  plan’ so  far. 

The  planning  pfobleih  used^ih  the  Hayes-Roths’ work  was  a  ioosely-constrmned 
one 'ihr  which  subjects,  using:a  niap  of  'a  town  and 'its  shops,  formulated  a  fealistic 
plan  indicatiiig  Which  effarids  from  a  list  they  would  do,  when  they  would  do 
them,  and  how  they  woiiid  travel  through  the  geographic  area  among  them. 
Subjects  used  their  own  experience  in  shopping  to  guide  their  plan  development, 
for  example,  they  allocated  a  certain  amount  of  time  for  accomplishing  a  certain 
kind  of  errand;  The  degree  of  detailing 'in  the  final  plan  was  not- controlled,  as 
the  plaits  were  not  executed  as  such.  We  have  developed  a  similar,  but  more 
tightly  defined  planning  task,  set  in  an  environment  called  SPLITS,  that  we  argue 
is  more  typical  oficomniand  and  control  (McCann  &  Esseris,  1991)..  In  our  task, 
subjects  are  required  to  plan  the  most  efficient’  way  for  shopping  robots  to  pick 
up  commodities  in  a  grocery  store,  while  at  the  same  time  satisfying  certain 
constraints.  Subjects  are  permitted-iise  of  limited  paper  and  pencil  planning  aids. 
They  are 'encouraged  to  try  and  optimize  their  solutions  and  their  plans  must  be 
developed  in  enough  detail  to  be  actually  executable  by  the  robots,  whose 
capabilities  are  limited  to  moving  through  the  aisles  and  picking  up  items.  In  the 
SPLITS  paradigm,  the  plans  developed  by  subjects  are  executed  to  provide 
feedback  on  the  solution,  and  there  is  a  well-delineated  distinction  between 
planning  and  execution. 

Ultimately  in  our  research,  we  are  interested  in  determining  whether  the 
opportunistic  model  holds  for  SPLlTS-type  tasks  of  planning  in  time  and  space. 
Ill  paftivcular,  we  wish  to  determine  whether  and  how  the  nature  of  planning 
changes  over  repeated  exposure  to  the  same  kind  of  problem. 

However,  the  first  step  in  this  line  or  research  is  to  determine  the  basic  cognitive 
processes  and  procedures  used  in  planning  in  SPLITiS  tasks.  This  step  is  neces¬ 
sary  because  there  is  relatively  little  known  about  how  peoj?le  approach  planning 
in  tasks  of  this  complexity.  It  is  this  analysis  that  is  reported  here. 

Thus,  there  were  two  main  goals  in  this  study.  The  first  goal  was  to  develop  a 
method  for  analyzing  the  cognitive  processes  associated  with  planning  for 
SPLITS  problems  in  time  and  space.  This  was  done  by  capturing  the  planning 
process  and  developing  a  coding  scheme  for  interpreting  the  protocols  given  in 
the  process.  We  were  especially  interested  in  seeing  whether  different  levels  of 
plan  abstraction  were  used  during  planning.  A  subsidiary  goal  to  this  main  one 
was  to  confirm  that- the  SPLITS  planning  task  could  be  accomplished  by  subjects 
and  that  the  paradigm  could  be  executed  as  expected. 

Our  second  goal  was  to  develop  a  model  for  efficient  planning  in  this  task,  based 
on  observations  of  planners  and  assuming  a  hierarchical  approach  to  planning. 


This  model;  will  be  tested  in  a  future  ,  experiment  to  determine,  ^he  degree  to 
which  planning,  in  thjs  t^k  conforms  .to  the  hierarchical  .versus  the  opportunistic 
approach. 


2  METHOD 

2.1  The  planning  task 

2.1.1  General 

Planning  was  carried  out  in  this  study  using  a  simple  implementation  of  a 
manual  version  of  the  SPLITS  environment.  SPLITS  is  a  general  environment 
for  studying  human  and  computer-aided  planning  in  time  and  space.  The  overall 
conceptual  design  of  SPLITS  is  described  in  a  separate  report  (McCann  & 
Essens,  1991).  A  brief  description  of  the  basic  manual  version  >of  SPLITS  is  given 
here. 

In  the  basic  version  of  SPLITS,  subjects  are  required  to  plan  how  to  pick  up 
commodities  in  a. grocery  store  using  shopping  robots.  The  store  is  presented  as 
a  two-dimensional  matrix  with  aisles  and  shelves  containing  grocery  commodities 
(e.g.,  eggs,  green  beans,  bread)  grouped  in  categories  (e.g.,  dairy,  vegetables, 
baked  goods).  The  shopping  robots  have  different  characteristics:  for  example, 
robots  could  have  different  speeds  of  travel  through  the  store,  and  hold  different 
numbers  of  commodities  in  their  baskets.  The  overall  task  of  the  subject  in  a 
session  is  to  plan  for  the  efficient  pickup  of  the  items  on  a  shopping  list,  using 
the  robots  available.  The  task  may  also  have  certain  constraints  on  the  order  of 
pickup  of  commodities. 

In  this  version  of  SPLITS,  planners  make  their  plan  u^ing  completely  manual 
methods.  They  are  given  a  "planning  board",  a  paper  map  of  the  store  with 
commodity,  locations,  marked,  and  a  number  of  colored,  pencils.  Planners  are  free 
to  mark  the  planning  board  in  whatever  way  they  wish  as  they  are  creating  their 
plan. 

Once  the  plan  has  been  detailed  to  the  planner’s  satisfaction,  it  is  played  out 
step-by-step  by  the  experimenter  on  a  separate  execution  board.  In  this  "execu¬ 
tion  phase",  the  subject  gives  orders  to  the  experimenter  on  how  to  move  the 
robots,  through  the  store  and  when  to  pickup  -items.  The  robots  are  represented 
by  markers  that  are  physically  moved  on  the  execution  board.  When  orders  are 
given  for  the  pickup  of  commodities,  these  are  physically  placed  in  the  robots’ 
baskets.  At  the  end  of  each  cycle  of  movement  and  pickup,  the  store  clock 
(represented  by  a  counter)  is  advanced  one  tick, 
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Although’  subjects  are  encouraged  tO'ihake-  as  complete  a  plan  as  they  can  before 
execution -starts,  they  are  pefrhitted  to  stop  at  anytime  during- execution  to  do 
more  planning  or  to  do  replanning.  During  this  time  the  store  clock  does  not 
run.  The  execution  done  to  that  point  cannot  be  revoked;  subjects  must  plan  on 
the  basis  of  the  current  location  and  state  of  the  robots. 

2,1.2  The  store  layout  and  shopping  list 

Two  basic  store  layouts  were  used  in  this  study,  each  organized  on  a  matrix  15  x 
10  (Fig.  1),  Each  type  of  layout  had  10  blocks  available  for  arranging  commodi¬ 
ties,  each  with  slots  for  6  commodities.  In  one  type  of  layout,  the  -blocks  were 
arranged  as  linear  rows  of  commodities;  in  the  other  they  were  organized  more 
as  islands.  The  blocks  corresponded  to  10  categories  of  grocery  store  commodi¬ 
ties:  baked  goods,  fruits,  vegetables,  meats,  condiments,  drinks,  snacks,  dairy 
products,  cooking  products,  cleaners;  Six  specific  commodities  appeared  in  each 
category.  Under  the  category  condiments,  for  instance,  the  commodities  were 
hagel,  jam,  peanut  butter,  sathbal,  vinegar  and  mustard:  For  each  of  the  two 
types  of  layouts,  five  random  assignments  of  commodity  categories  to  available 
blocks  was  made,  and  then  the  six  commodities  within  the  category  were  further 
randomly  laid  out  within  the  blocks.  The  commodities  in  each  category  were  the 
same  in  each  case.  One  square  on  the  matrix  was  designated  the  entrance 
(labelled  "IN")  and  a  square  on  the  opposite  side  of  the  board  the  exit  (labelled 
"OUT%  Thus  there  were  a  total  of  ten  different  layouts  of  store  commodities. 

Shopping  lists  were  created  by  randomly  choosing  15  items  from  the  total 
commodity  set  of  60,  ensuring  that  at  least  9  out  of  the  10  groups  were  repre¬ 
sented  in  the  list  by  at  least  one  commodity,  Tv/enty  lists  were  so  created  and 
assigned  randomly  to  the  ten  layouts,  thus  giving  a  total  of  20  problem  spaces 
(combination  of  list  and  layout).  Three  were  selected  as  problems  for  the 
training  sessions.  From  the  remainder,  a  different  random  selection  of  12  for 
each  subject  was  made  for  the  test  sessions. 

Paper  "planning  boards"  for  each  problem  v/ere  created  consisting  of  the  store 
layout  and  the  shopping  list  (Fig.  2).  A  large  version  of  the  layout  was  created 
for  use  as  the  execution  board. 

2.1,3  Specific  task  used  in  the  study 

The  task  in  this  study  was  to  create  a  plan  for  efficient  pickup  of  all  items  on  the 
shopping  list.  The  subject  had  available  two  robots:  a  red  robot  that  travelled 
one  square  per  tick  of  the  store  clock;  and  a  blue  robot  that  travelled  two 
squares.  The  robots  travelled  along  the  aisles  in  the  store.  They  could  travel 
simultaneously,  that  is,  both  could  travel  during  one  tick  of  the  store  clock. 
However  robots  could  also  rest  on  a  square  for  one  or  more  ticks. 


li 

commodity  slot 


The  shopping:  basket  -  of  -the .  redjrpbot  could  ■  hold,  lOatems;  and  ;that.  of.  the,  blue 
robot-held. six;  A-.rpbQtrCould  pick  up.  andtemdfdt  passed  the  item.  Robots  could 
^so>  tf^fer  items  between  thejr  baskets  jf  dhey  were  standing-  on.  the-  s^e 
square.  A;  transfer  cost  one,- tick. 

In  addition,  there  were,  three  constraints  with  which  the.  plan  had  to.-comply: 

a) (  Items  in.  the  dn/ik  category  had-.. to  b.e  placed  in,  the  bottom  of  the 

basket;. 

b)  Items.in  (bt: baked  goods  category  .had  to  -be-placed  at>  the  top  ,of->the 
basket; 

c)  The. daily  products  had  to  be  picked  up  near  the  end  of.the  time-in 
the  store. 

Tfie  first  two  of  the  constraints  were  absolute:  the  robot/ejqjerimenter  would 
refuse  to  pick  up  an  item  durlng  plan  execution;  if  it' violated-the  constraint.  The 
third  constraint  was  left  open  to  interpretation  by  the  planner.  ITiese  constraints 
also  applied  when  a  transfer  was  made. 

Both  robots  were  standing  on  the  "IN"  square  at  the  start  of  planning.  The 
planner  was  instructed  to -make  and  execute  a  plan  that  picked  up  all  the  items 
on-.the  list,  complied  with  the  constraints,  and  minimized  the,  time  that  the  robots 
spent  in  the  store.  The  task  was  complete  when  all  itemston  the  list  had -been 
picked  up  and  both  robots  stood  on  the  "OUT'  square  of  the  execution  board. 

Three  simpler  versions  of  the  planning  problem  were  used  to  familiarize  the 
subjects  with  the  task  and  to  give  some  practice  in  providing  think-aloud 
protocols.  The  first  required  pickup  of  15  items  using  only  one  robot  (speed  2 
squares  per  tick)  whose  basket  capacity  was  15.  There  were  no  constraints  in  this 
problem.  Tlie  second  training  task  used  a  robot  with  .speed  one.  square  per  tick 
and  also  required  that  all  the  constraints  be  satisfied.  TTie  third  training  problem 
introduced  two  robots  (red  -and  blue)  for  accomplishing  the  task,  but  without  the 
constraints  on  pickup. 


2.2  Procedure 

Participants  were  seated  at  a  table  in  front  of  the  planning  board,  which  was 
fastened  to  the  table.  Colored  pencils  and  an  eraser  were  available  on  the  right. 
The  experimenter  sat  on  the  planner^  left.  The  execution  board  Was  mounted  on. 
a  small  stand-in  front  of  the  experiinenter,, easily  visible  to -the  subject,  but, far 
enough  away  that  the  planner  could  not  conveniently  point  to  it,  A  video  camera 
was  focussed  on  the  planning  board  and  recorded  ail  interactions  with  the,  board. 
The  video  recording  included  a  time  code.  An  additional  recording  was  made  of 
the  audio  only. 
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The  planner;  read  first  “a-  gehefal  witteh'  introduction*  <td  the  task,  including  a 
description  pTai  typicar  store,  the  general-idea  6f>the  pla.nnirig'task«and-h6w-the 
execution  of 'the 'plari  worked;  Three  traihihg  sessions  were  then  given.  Three 
sessions  with  the  full  test  problem,  with  different  layouts  and  lists  Were  carried 
out  on  four  subsequent  days.  For  each  ses.sion,  explicit  written  instructions  were 
providdd^cohcefnirig  the  rules  and  conditions  for  the  problem.  In  each  case,  the 
task  of  the  subject  was  stated  as  follows:  "Plan  and  execute  the  pickup  of  items 
on  the<shopping  list  sodhat  it-is  done  in-a*minimUm  number  of  clock  ticks.  The 
robot(s)  must  be  at  the  square  marked  OUT  for  the  plan  to  be  complete." 
Subjects  could  refer  to  the-written  instructions  during  planning  if  required. 

During’  the  planning  phase,  participants- were  required  to  -give  a  running  verbal 
account  of  the  plan  development.  The  planner  was  under  no  time  pressure 
during  this  phase.  Once  the  plan  had  been  completed  to  the  subject’s  satisfac¬ 
tion,  it  was  exetuted  on  the  execution  board.  Execution  took  the  form  of  orders 
given,  to  the  experihienter  who  played  the-part- of  4he  robots.  The-orders  were  of 
the  form:  "Red  moves  one  square  down- and  picks  up  carrots;  blue  moves  two 
squares  right,  no  pickups".  The  experimenter  played  out  the  orders  on  the 
execution  board  precisely  as  given,  except  in  the  case  where  a  pickup  would 
violate>the  rules  givendn  the  task  (e.g;,  the  carrots  would  be  placed  on  top  of'the 
cookies  in  the  basket).  At  the  end  of  each  cycle  Of  move/pickup,  the  counter 
representing  the  store  clock  was  incremented.  The  total  number  of  ticks  required 
to  satisfactorily  complete  the^ask  was  recorded. 

The  protocols  of  two  planners  solving  12  different  versions  of  the  planning 
problem  were  collected  in  this  study.  Both  had  been  educated  to  a  graduate 
university  ilevel. 


2.3  Analysis  method 

Six  of'the  twelve  problem  sessions  carried  out  by  each  planner  were  selected  for 
detailed  analysis.  (Not  all  protocols  were  analyzed  due  to  the  amount  of  labor 
involved.)  They  were  evenly  distributed  in  time  over  the  12  sessions.  The  data 
were  treated  as  pooled  over  the  sessions. 

The  verbal  transcripts  from  these  sessions  were  first  transcribed  into  written 
form.  The  videotapes  for  the  planning  sessions  were  reviewed  together  With  the 
annotated  plannitig  boards  created  during  the  trials.  For  each  problem,  a 
graphical  map  was  made  identifying  and  labelling  the  annotations  made  by  the 
planner  (e.g.,  lines  designating  routes);  the  location  of  diectic  references  (e;g.,  a 
transfer  point  indicated^  by  the  word  "this");  and  other  spatial  areas  of  focus 
referred  to  during  planning.  Following  this,  a  scheme  for  coding  the  graphical 
interactions  of  the  subjects  with  the  objects  on  the  planning  board  was  devel¬ 
oped.  TTie  graphical  protocol  for  each  problem  session  was  then  coded  froni  the 


videotape  with  the  help  of  the  graphical  map  and  inserted  alongside  the  written 
verbal  .protocol  to  produce  a  verbal  plus  graphical  protocol. 

The  verbal + graphical  protocol  provided  the  material  for  the  main  analysis, 
which  was  conducted  according  to  the  procedures  for  analysis  of  verbal  protocols 
outlined  in  Ericsson  and  Simon  (1984).  In  the  first  stage,  we  identified  the 
objects  manipulated  or  used  by  the  planners  in  creating  a  plan.  Analysis  of  the 
verbal + graphical  protocols  lead  to  the  identification  of  a  set  of  primitive 
planning  actions  involving  these  objects  or  concepts.  Common  actions  were  then 
grouped  into  categories. 

The  following  section  gives  the  results  of  the  above  analysis  and,  in  addition, 
identifies  three  levels  of  abstraction  at  which  planning  was  conducted.  The 
subsection  giving  the  description  of  the  levels  of  plan  specificity  is  followed  by  a 
complete  verbal + graphical  protocol  for  one  problem  in  which  a  plan  action  code 
is  applied  and  the  level  of  abstraction  of  plan  development  is  identified 
chunk-by-chunk  in  the  protocol.  The  section  concludes  with  some  general 
observations  on  the  planning  behavior  of  the  two  planners. 


3  ANALYSIS 

3.1  Objects  and  concepts  used  in  planning 

Planners  used  a  vocabulary  of  objects  and  concepts  in  the  process  of  carrying  out 
the  planning  task.  Some  of  these  were  given  explicitly  as  part  of  the  problem 
domain,  for  example,  the  store  and  its  commodities,  the  robots,  the  rules  for 
arranging  items  in  the  basket  or  for  transferring  items  between  robots.  Certain 
concepts  (e.g.,  the  store)  had  a  physical  representation  which  was  manipulated 
during  planning;  other  concepts  existed  only  at  a  more  abstract  level  (e.g.,  the 
rules)  and  had  no  physical  manifestation.  Further  additional  objects  and  concepts 
were  generated  by  the  planner  in  the  process  of  creating  the  plan,  for  example, 
routes,  transfer  events,  transfer  locations,  pickup  points.  The  first  step  in  the 
analysis  process  consisted  of  identifying  these  objects  and  concepts.  A  list  of 
them  in  tabular  form  is  given  in  Table  I.  Note  that  the  list  has  been  compiled 
from  objects  and  concepts  used  by  both  planners  over  all  problem  sessions.  It 
was  not  the  case  that  a  given  planner  referenced  all  the  concepts  in  creating  a 
given  plan. 

3.1.1  Domain  objects 

The  domain  objects  manipulated  or  created  during  planning  consisted  of  the 
commodities  In  the  store,  the  store  itself,  the  robots,  routes  for  the  robots  to 
follow,  pickup  points  for  commodities,  and  transfers.  The  first  three  types  of 
domain  objects  were  presented  as  part  of  the  original  problem  statement;  the 
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last  three  were  concepts  that  were  usually  (although  not  always)  generated  by 
planners  during  the  process  of  plan  creation.  In  some  cases  the  latter  concepts 
were  given  some  physical  manifestation  by  the  planner,  e.g.,  a  symbol,  annota¬ 
tion,  etc. 

Robots  can  be  described  in  relatively  simple  terms;  there  are  two  kinds  of 
robots,  labelled  "red"  and  "blue"  with  characteristics  basket  capacity  (11  items  for 
red;  6  items  for  blue)  and  speed  (1  square  per  tick  for  red;  2  for  blue).  Robots 
also  have  the  characteristic  that  they  "can  transfer  items".  There  is  a  physical 
representation  of  the  robots  in  the  execution  environment,  but  not  in  the 
planning  environment. 

The  concepts  "store"  and  "commodities"  are  physically  represented  by  graphics 
and  labels  in  both  the  planning  and  execution  spaces.  Both  have  the  property 
that  they  can  be  described  using  a  hierarchy  of  specification.  The  store  can  be 
considered  as  a  spatial  partitioning  into  aisles  and  shelf  blocks.  At  a  lower  level 
of  detail  in  the  spatial  hierarchy,  the  aisles  can  be  considered  in  terms  of  individ¬ 
ual  component  squares  (including  the  special  squares  "IN"  and  "OUT');  and  the 
shelf  blocks  can  be  considered  as  slots  in  which  the  commodities  are  placed.  The 
commodities  have  a  natural  categorization  hierarchy  presented  explicitly  as  part  of 
the  original  problem;  there  are  groups  of  items  (e.g.,  drinks,  dairy,  meat)  and 
individual  items  contained  within  the  group  (orange  juice,  cassis,  beer,  etc.).  In 
addition,  the  planner  sometimes  partitions  the  items  into  convenient  categories 
during  plan  creation,  This  partitioning  can  be  on  a  spatial  basis  ("this  group  of 
items  here  /  the  rest").  Or  it  can  be  on  the  basis  of  commodities  that  are 
affected  by  the  rules  (e.g..  Spa,  cookies,  bread,  butter  and  yogurt)  versus  the 
remaining  items  on  the  shopping  list.  Another  kind  of  partitioning  is  a  division  of 
the  shopping  list  into  those  items  to  be  picked  up  by  red  and  those  assigned  to 
blue. 

Some  of  the  concepts  or  objects  generated  by  the  planners  also  have  a  hierarchy 
associated  with  them,  but  of  a  slightly  different  kind.  We  term  this  a  specification 
hierarchy.  Routes  for  robots  to  follow  may  be  specified  approximately  by  the 
planner  by  being  traced  (but  not  drawn)  on  the  planning  board;  routes  may,  by 
contrast,  also  be  drawn  heavily,  square-by-square,  with  the  pickup  points  also 
marked.  Similarly,  the  concept  of  transfer  of  goods  between  robots  has  different 
levels  of  specificity.  The  very  existence  of  a  transfer  event  is  a  first  level  of 
detailing.  Once  the  need  for  a  transfer  is  established,  it  can  be  considered  from 
tw-o  perspectives;  in  terms  of  spatial  location  (where  in  the  store  does  it  occur?) 
and  in  terms  of  the  items  that  are  transferred.  The  location  can  be  specified 
grossly  as  a  general  area  ("around  the  milk")  or  it  can  be  pinned  to  a  particular 
square  in  the  store.  The  transferred  items  can  be  described  simply  as  the  number 
of  items  ("blue  will  give  red  two  items")  or  in  terms  of  the  precise  items  to  be 
transferred  ("blue  will  give  red  the  butter,  and  cookies"). 


Table  I  Domain  objects  and  concepts 


Objects  &  Concepts 

Type 

Subdivisions  Used 

Commodiues 

category  hierarchy  • 

-  groups  of  items  (e.g.,  drinks,  vegies) 

-  individual  items  (e:e..  carrots,  milk) 

Dontain  Objects 

partitioning  *• 

-  clusters  of  items  (spatially  grouped  or  grouped  by 
assignment)/ 
individual  items 

-"spcciar  goods  (i.e..  linked  to  ruIes)/othcrs  • 

Store  * 

spatial  hierarchy 

-aisles  and  shelf  blocks 

-  specific  squares  (e.g.,  holding  item;  IN;  OUT) 

Robots  * 

partitioning 

-  red  with  characteristics:  basket  capacity  of  1 1;  speed 

of  1  sq/tick;  can  transfer 

-  blue  with  characteristics;  basket  capacity  of  6; 

speed  of  2  sq/tick;  can  transfer 

Routes  *• 

location  hierarch” 

-traced 

-drawn 

-drawn  with  pickups 

partitioning 

•  whole  route  (for  roboO/route  fragments 

existence 

Transfer  •• 

location  hierarchy 

•  iransarca 

•  trans  point  (i.e..  sq) 

transfenred  item  hierarchy 

-  trans  "basket" 

-  trans  number 

-  trans  specific  items 

Pickup 
points  •* 

location  hierarchy 
-  pickup  area 

•  pickup  point  (i.e..  square) 

Rulcs/Conditions  * 

for  placement 

B1  -  drinks  on  bottom 

B2- baked  goods  on  top 

B3- dairy  near  end 

• 

for  transfer 

Tl  •  robots  must  be  on  same  sq  to  uansfer 

T2  -  transferring  costs  a  tick 

Goals 

goal  hierarchy 

-  main  goal*:  transport  all  goods  listed  in  shortest 

lime  to  OUT 

-  subgoals  *• 

denotes  given  objects  or  concept;  *•  denotes  subject-created  object  or  concept 
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3.1.2  Rules  and  goals 

The  concepts  discussed  above  are  represented  as  physical  objects  in  the  problem 
domain.  There  are  other  concepts  -  the  rules  for  behavior  of  robots,  the  goal  of 
the  planning  task  --  that  are  also  manipulated  during  planning.  The  following 
rules  and  goals  entered  into  subjects’ plans: 

a)  Basket,  rule  1  -  Drinks  must  be  placed  on  the  bottom  of  the  robot’s 
basket 

b)  Basket  rule  2  -  Baked  goods  must  be  placed  on  the  top  of  the  robot’s 
basket 

c)  Basket  rule  3  -  Dairy  products  must  be  picked  up  near  the  end  of  the 
time  in  the  store 

d)  Transfer  rule  1  -  Robots  must  be  on  the  same  square  to  transfer  items 

e)  Transfer  rule  2  -  Transferring  costs  one  tick 

f)  Main  goal  -  Using  the  resources,  transport  all  items  listed  to  OUT  in 
the  fewest  number  of  ticks. 

The  object^  and  concepts  identified  above  are  the  targets  for  the  planning 
actions  described  in  the  next  subsection. 


3.2  Planning  actions 

The  analysis  of  the  verbal  and  graphical  protocols  of  the  two  planners  permitted 
identification  of  a  set  of  primitive  planning  actions  that  accounted  for  the 
majority  of  the  subjects’  activity.  About  90%  of  the  verbal  and  graphical  actions 
was  accounted  for  by  the  coding  scheme.  The  remainder  were  comments  or 
questions  to  the  experimenter,  or  protocol  fragments  for  which  there  was  no 
adequate  code.  The  coding  was  done  by  one  person,  so  the  reliability  of  the 
coding  scheme  was  not  assessed. 

The  actions  can  be  considered  as  operators  that  either  create  or  act  upon  a 
target  object  or  concept.  T^e  set  of  primitive  actions,  their  associated  objects  and 
modifiers,  their  definitions,  and  examples  are  given  in  Table  II.  Columns  2-5  give 
the  syntax  of  the  action.  The  action  name  is  given  under  the  heading  "Plan 
Action",  and  the  target  of  the  action  under  the  next  column,  ’Target".  Additional 
special  Modifiers  of  the  action  are  shown  in  the  next  column  and  the  Robot,  if 
applicable,  in  the  subsequent  one.  For  example,  the  action  order  pickup  sets  the 
possible  order  for  pickup  of  certain  target  objects.  The  target  of  the  action  could 
be  individually-named  iletns,  a  group  of  items,  or  a  cluster  of  items.  In  addition, 
the  action  might  be  modified  by  an  assignment  of  the  pickup  to  either  the  red  or 
blue  robot. 


Table  ITcontinucd 


MEASURE  PLAN  Measure  route  time  of  route.  Estimate  or  count  the  number  -"red's  gonna  move  1-31  (counts)"  follow  route  (82; 

rouicfrag  of  ticks  for  a  particular  "it's  15  steps  from  here"  partB3) 

_ robot  to  travel  a  route _ _ _ _ 


Table  II  continued 


\ 
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Certain  of  the  primitive  planning  actions  had  common  characteristics  and  were 
therefore  aggregated  on  the  basis  of  similarity  into  eight  categories  (column  1): 
orient,  adopt  strategy,  create/modify  plan,  deduce  implication,  measure  plan, 
evaluate  plan^  conclude,,  consolidate/review. 

U  is  convenient  to  discuss  t  the  planning  actions  in  a  different  order  than  they  are 
given  in  the  table.  The  bulk  of  the  planning  actions  fall  into  the  category 
create/modify  plan.  They  will  be  described  first.  Actions  that  lead  to  deductions 
about  one  part  of  the  plan  on  another  part  will  be  discussed  next,  followed  by 
measurement,  eyaluatiors.  and  conclusion  actions.  The  orientation  and  consolida¬ 
tion  actions  will  be  discussed  last. 

The  planning  actions  in  the  main  category,  create/modify  plan  are  of  four  kinds; 

a)  assignment  of  certain  item(s)  to  be  picked  up  by  a  particular  robot; 

b)  the  ordering  of  the  pickup  of  items  in  time; 

c)  the  construction  of  routes  for  robots  to  follow; 

d)  the  specification  of  transfer  events. 

The  simplest  kind  of  planning  action  is  assign  ilem(s)  to  red/blue.  Here  the 
planner  allocates  an  item  or  set  of  items  on  the  shopping  list  to  one  of  the  two 
robots  for  pickup,  as  indicated,  for  example,  by  the  phrase  "blue’s  going  to  get 
ham,  eggs,  window  cleaner ..."  The  target  of  the  action  may  be  detailed,  as  in  this 
example,  or  specified  more  generally  as  a  group  of  items,  not  individually  named, 
e.g.,  "red’ll  pick  up  the  dairy  products  ..."  Sometimes  the  planner  has  previously 
formed  a  spatial  clustering  or  other  partitioning  of  items  that  is  used  as  the 
target  of  the  action,  for  example,  "these  will  be  picked  up  by  blue"  where  the 
word  "tnese"  is  clarified  by  a  gestural  scoping  of  certain  items  on  the  planning 
board.  Thus  there  is  a  range  of  levels  of  object  specificity,  from  rough  to 
detailed,  that  can  be  invoked  by  the  planner  in  describing  the  target  of  the 
assignment  action.  Items  for  pickup  may  be  designated  roughly  as  a  spatial 
cluster;  by  group  name  (possibly  with  accompanying  scoping  gesture);  or  by 
individual  name  (e.g.,  carrots,  eggs)  and  specific  pointing  gesture. 

A  second  kind  of  planning  action,  order  pickup,  involves  the  ordering  of  item 
pickup  during  the  time  span  of  the  plan  execution,  e.g.,  "the  pina  colada  has  to 
be  picked  up  first".  As  in  the  case  of  assign  item,  the  target  of  the  action  may  be 
specified  roughly  (e.g.,  "first  I’ll  get  the  things  at  the  top  of  , the  store,  then  those 
at  the  bottom")  or  in  detail,  by  name.  There  were  also  instances  in  the  protocols 
in  which  the  ordering  of  picla.p  was  folded  into  a  statement  assigning  an.  item  or 
group  of  items  to  a  robot,  for  example,  "red’ll  pick  up  the  dairy  products  at  the 
end". 

A  third  kind  of  planning  action  involves  the  construction  of  routes  for  the  robots, 
to  follow  in  picking  up  items:  construct  route.  Sometimes  the  route  is  loosely 
described  in  verbal  form,  for  example,  "redls  gonna  come  right  down  and  out,  the 
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most  efficient  route".  In  niany  cases,  the  jjlanner  graphically  traces  the  route  out 
on  the  planning  board,  sometimes  without  actually  marking  the  board,  other 
times,  drawing  the  route  out  explicitly.  Often,  only  a  portion  of  the  total  route 
for  a  robot,  named  a  "routefrag",  is  drawn  at  a  time.  Once  several  routefrags 
have  been  created,  then  the  order  of  their  execution  may  be  explicitly  designated 
by  the  dtder  route  action;  In  almost  all  c^es,  the  route  or  routefrags  so  con¬ 
structed  are  immediately  assigned  to  either  the  red  or  blue  robot.  If  this  was  not 
the  case,  they  could  be  later  assigned  to  a  robot  by  the  action  assign  route.  The 
construction  of  a  route  usually  implies  that  the  items  oh  the  list  that  lie  along 
the  constructed  route  are  to  be  picked  up' by  the  robot  that  follows  the  route. 
The  planner  sometimes  marks  the  pickup  points  of  items  explicitly  {hy  specify 
pickup  point),  especially  if  the  route  passes  items  that  are  on  the  list  but  that  are 
not  intended  for  pickup  at  that  time. 

In  addition  to  the  construction  of  routes,  the  planner  may  also  specify  the 
transfer  of  goods  between  robots,  usually  from  the  blue  to  the  red  since  the  red 
basket  capacity  is  greater.  Sometimes  the  planner  first  establishes  the  need  for  a 
transfer  to  take  place  (specify  transfer  event)  and  then  later  determines  the 
location  of  the  transfer  (specify  transfer  location)  and  which  items  are  to  be 
transferred  (specify  transfer  commodities),  as  in  the  following  sequence  of  phrases: 

"blue  is  going  to  run  into  red  somewhere"... 

"blue  will  meet  red  right  by  the  milk"... 

"blue  gives  off  these  items"  points  to  baked  goods 

Both  the  location  and  the  item  set  can  be  specified  in  varying  levels  of  detail.  In 
the  example,  the  location  of  the  transfer  is  relatively  precisely  defined,  whereas 
the  items  to  be  transferred  are  not  detailed  individually,  but  are  simply  catego¬ 
rized  under  the  heading  "baked  goods". 

It  was  typical  that  the  plan,  as  defined  by  routes,  assigned  pickups,  and  transfer 
events,  underwent  revision  as  the  planner  worked.  The  following  plan  actions 
covered  the  cases  where  the  current  working  plan  was  changed: 

a)  modify  assignment  -  change  a  previous  assignment  of  items  to  a  robot 
by  de-assigning  (e.g.,  "no,  blue  will  not  pick  up  the  roasted  nuts")  or 
re-assigning  (e.g.,  "red’ll  have  to  pick  up  the  onions  instead  of  blue") 

b)  modify  route  -  change  a  proposed  route  for  a  robot  by  adding  or 
removing  a  routefrag 

c)  modify  transit  location  -  change  the  working  location  of  a  transfer 
event 

d)  modify  transfer  commodities  -  change  the  items  to  be  transferred. 

During  the  consuuction  of  the  plan,  the  planner’s  protocol  sometimes  provides  a 
chain  of  deductions  that  lead  to  a  conclusion  about  how  a  particular  move  will 
influence  or  constrain  later  moves  by  the  robot:  For  example,  the  planner  may 


25 


reason  that  "if  red  picks  up  the  cookies,,he  can’t  pick- up  the  !iVorst"  (presumably 
because  of  the  rule  that  no  item^  can  be  .  placed  on  top  of  baked' goods  in  the 
basket).  These  kind  of  actions  have  been  designated  deduce  implications.  In  the 
example,  the  deduction  stemmed  from  the  assignment  of  cookies  to  the  red 
robot.  Deductions  can  also  be  made  based  on  the  order  of  pickup,,  the  route 
proposed  for  a  robot,  etc.  Furthermore,  since  the  moves  generated  for  one  robot 
can  also  have  implications  for  the  other  robot,  the  deduced  impact  may  be  upon 
the  other  robot. 

Sometimes  the  planner  alluded  to  goals  or  intentions  about  plan  actions  to  be 
taken.  These  intentions  were  derived  from  characteristics  that  the  plan  , per  se 
should  have.  These  actions  were  coded  as  adopt  strategy.  The  subject  might  say, 
for  example,  "I  have  to  find  a  route  where  the  drinks  can  be  picked  up  so  that 
they  go  on  the  bottom".  In  this  case,  the  desirable  plan  characteristic  is  that  the 
drinks  must  go  on  the  bottom  of  a  basket.  In  other  cases,  the  planner  might  not 
be  so  explicit  about  his  intention,  e.g.  "the  robots  should  move  as  much  as 
possible  at  the  same  time".  Here  the  assumption  is  that  the  planner  then  adopts 
the  strategy  of  finding  such  a  plan,  but  the  procedure  for  achieving  the  goal  may 
not  be  explicitly  stated. 

Part  of  the  planning  task  involved  the  measurement  and  evaluation  of  the  plan. 
Plan  measurement  concerned  mainly  the  counting  or  computing  of  the  number 
of  ticks  that  it  would  cost  for  a  robot  to  travel  a  proposed  route  {measure  route 
lime,  compute  route  time)',  and  the  counting  of  the  number  of  items  that  would 
be  picked  up  by  a  robot  following  a  route  or  route  fragment  (measure  no.  items 
assigned).  Several  different  kinds  of  evaluation  actions  could  then  be  carried  out. 
The  planner  might  compare  the  time  that  it  would  cost  for  red  and  blue  to  travel 
their  two  routes  simultaneously,  as  in:  "that’s  8  more  steps  that  red  has  to  take 
than  blue".  The  underlying  motivation  for  this:actlon  is  that  the  routes  should  be 
of  equal  length  for  the  plan  to  be  efficient.  Or  the  planner  might  assess  the  total 
time  that  a  plan  would  cost,  to  see  whether  the  time  is  "satisfactory",  e.g.,  "under 
30,  thatls  what  I  likel".  The  planner  must  also  ensure  that  the  basket  capacity  of 
a  robot  will  not  be  exceeded  at  ai^  point  (designated  check  against  capacity). 
Other  kinds  of  evaluations  are  made  to  ensure  that  the  rules  are  being  satisfied 
and  that  all  items  on  the  list  are  picked  up. 

Related  to  the  evaluation  of  the  plan  or  parts  of  it  were  conclusions  by  the 
planner  to  either  accept  or  reject  the  proposed  assignment  of  items  to  robots,  the 
ordering  of  items  for  pickup  or  the  proposed  route/routefrag.  Statements  like 
"yeah,  I’ll  do  it  like  this"j  or  "that  won’t  work"  indicate  that  the  planner  has  made 
a  conclusion  about  the  plan  or  a  part  of  it. 

Tw-o  other  categories  of  planning  action  were  also  observed.  In  one  category, 
designated  Orient,  the  planner  focussed  on  the  problem  requirements,  the 
resources  for  solving  the  problem,  the  rules  and  the  layout  of  the  store.  These 
kinds  of  actions,  which  usually  occurred  at  the  beginning  of  the  planning  process 


26 


or  atithe  beginning  of  a  new  phase  of  planning,  served  to  refresh  the  information 
cohcenung  the  problem  and  its  constraints.  For  example,  the' planner  might  note 
rules,  that  "the  cookies  have  to  be  near  the  end".  The  implicati6i«  of  the  rules 
might  also.be  considered,  as  in  "I  think  the.  cookies  on  top  will  not  be  a  problem 
for  the  transfer".  This  kind  of  action  was  designated  translate  rules  in  context. 
Another  kind  of  orienting  action. occurs  when  the  planner  transforms  the  represen¬ 
tation  of  the  problem  by  marking  .the  items  on  the  shopping  list  on  the  store 
layout. 

The  counterpart  of  the  Orient  category  was  the  Gonsolidate/Review  category, 
whose  actions  usually  occurred  at  the  end  of  a  planning  phase.  Here  the  planner 
would  join  routes  together  in  sequence,  redraw  the  routes,  remark  the  transfer  or 
pickup  points  and,  in  general,  review  the  plan. 


3.3  Levels  of  plan  speciHcity 

The  planning  actions  described  above  operate  on  the  objects  and  concepts  given 
in  the  task  (e.g.,  commodities,  store  layout,  robots)  to  transform  them  into  a  new 
set  of  objects  and  concepts  that  make  up  the  plan  (e.g.,  routes,  transfer  events, 
pickup  events).  The  plan  itself  can  be  characterized  in  differing  degrees  of  detail. 
A  rough  plan  may  call  simply  for  "the  red  robot  to  go  through  the  center  of  the 
store,  while  the  blue  robot  picks  up  items  on  the  periphery".  This  level  of  plan 
detailing  is  insufficient  to  ensure  that  the  task  can  be  satisfactorily  accomplished 
during  the  execution  phase.  There  is  not  enough  detail  established  to  determine 
whether  the  rules  for  pickup  will  be  satisfied,  or  indeed,  whether  all  the  items  on 
the  list  will  be  picked  up.  For  the  plan  to  be  satisfactory,  it  is  necessary  that  the 
planner  decide  fairly  precisely  how  the  robots  are  to  move,  and  at  which  points 
in  the  sequence  of  move  events  the  pickups  and  transfers  are  to  occur.  Finer 
detailing  is  required  if  the  main  goal  of  the  plan  is  to  be  accomplished,  that  is,  if 
the  time  that  the  robots  spend  in  the  store  is  to  be  minimized;  In  this  case,  the 
planner  must  attempt  to  eliminate  all  unnecessary  moves  by  considering 
step-by-step  the  actions  of  the  robots  and  how  they  are  co-ordinated  against  each 
other. 

The  verbal  and  graphical  protocols  give  evidence  that  planning  is  carried  out  at 
different  levels  of  detail.  We  have  been  able  to  distinguish  thret  wels  of  detail 
on  which  planning  occurs.  The  first  level  (Level  1)  involves  a  very  rough  assign¬ 
ment  of  commodities,  ordering  of  commodity  pickup  or  routing  of  robots.  The 
verbal  indications  of' planning  at  this  level  are,  for  example,  gross  assignment  of 
items  (e.g.,  "these  to  red  and  the  rest  to  blue");  rough  ordering  of  item  pickup, 
often  based  on  two  or  three  major  spatial  clusters  of  items  (e.g.,  "this  group  of 
items  first  and  then,  those");  and  rough  descriptions  of  routes  (e.g.,  "one  robot 
will  circle  and  the  other  will  go  over  and  down").  Gestural  evidence  of  planning 
at  Level  1  includes  scoping  actions  covering  large  sections  of  the  store  on  the 
planning, board  (possibly  using  the  whole  hand)  to  define  clusters  of  items  or  to 
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propose  routes.  At  this  level,  the  possibility  of  a  transfer  is  considered,  but  no 
details  of  itsdocation  or  the  items  involved  are  provided.  The  plan -at -this  levebis 
rarely  evaluated. 

Planning  at  a  second  level  of  detail  involves  a  firmer  specification  of  item 
assignment,  pickup  ordering,  route  construction  and  transfer  specification. 
Assignment  of  items  to  robots  and  the  ordering  of  pickup  is  done  on  the  basis  of 
groups  of  items  (e.g.,  vegetables),  or  on  the  basis  of  previously-defined  clusters. 
Routes  are  structured  by  references  to  spatial,  divisions  like  aisles,  and  the 
planner  may  use  back-and-forth  motions  along  an  aisle  to  show  a  general 
pathway.  Proposed  routes  are  constructed  by  being  traced  with  a  finger  or 
sketched  lightly  in  pencil,  often  with  founded  corners.  The  drawings  are  accom¬ 
panied  by  verbal  descriptions  that  are  non-specific,  e.g.,  "red  will  go  something 
like  this".  The  transfer  area  is  determined  (within  2  or  3  squares),  and  an 
estimate  made  of  the  size  of  transfer  needed  (number  of  commodities).  For 
example,  the  planner  might  trace  a  route  out  (for  blue)  and  at  the  same  time  say 
"he  could  pick  up  the  items  here  and  go  through  here  and  give  all  the  items  he 
has  picked  up  to  red".  The  planner  will  usually  ensure  that  the  capacity  of  the 
robots’  basket  is  adequate  for  the  assignment,  but  this  assessment  is  rough.  The 
evaluation  of  the  timing  of  the  plan  (on  the  basis  of  robot  speed)  is  still  coarse. 
There  may  be  some  tuning  of  the  times  for  red  and  blue  routes,  but  the  mea¬ 
surement  and  comparison  is  approximate,  as  indicated  by  phrases  such  as  "blue 
has  to  wait  too  long  here  for  red"  or  "these  routes  cost  about  the  same". 

Planning  at  Level  3  involves  the  detailed  assignment  of  items  to  robots,  along 
with  precise  determination  of  the  robots’  routes  (and  thus  the  order  of  pick  up) 
and  the  specification  of  the  transfer.  Planning  at  this  level  is  characterized  by 
consideration  of  individual  items  on  the  shopping  list  (rather  than  groups  of 
items),  and  by  the  selection  of  the  most  efficient  pickup  points  (squares).  The 
following  is  an  example  of  planning  at  Level  3  extracted  from  one  planning 
protocol: 

"redls  gonna  come  in"  draws  route  (Rl) 

"and  he’s  gonna  pick  up  the  Spa"  draws  route  (Rl) 

"and  then  he’s  gonna  backtrack  one  and  pick  up  the  green  beans" 
draws  route  (Rl) 

"maybe  even  dodge  for  the  onions"  draws  route  (Rl) 

"and  might  even  go  get  the  sugar"  draws  route  (Rl) 

"and  then  come  back  on  his  way  so  that  he  can  pick  up  the  cheese, 
cream  and  yogurt  toward  the  end"  draws  route  (R2) 

"and  then  head  out  the  door”  draws  route  (R2) 

Route  fragments  or  routes  are  drawn  in  detail,  more  heavily  than  at  Level  2. 
The  planner  often  counts  the  number  of  items  to  be  picked  up  and  computes  the 
effects  of  the  transfer  of  items  to  be  certain  that  the  basket  capacity  of  the 
robots  (especially  the  blue)  is  not  exceeded.  The  measurement  of  route  times 
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involves  counting  of  the  number  of  squares  to  be  travelled,  and  attempts  to 
balance  the  workioad  between  the  robots  by  re-assignment  of  single  items  and 
slight  modifications  in  the  route.  The  following  protocol  fragment  is  an  example: 

"if  red  goes  gets  the  gum 
red’lbbe  sitting  idle  ... 

red’ll  just  be  hanging  out  for  the  longest  time 

well,  7  moves  or  so 

now.if  red  were  to  ignore  the  gum 

and  get  the  salt 

that  would  be  1-25  (counts)  moves 
and  I  think  that’s  what  I  counted  for  blue" 

Finally,  in  Level  3  planning,  the  exact  square  for  the  transfer  is  designated  (and 
may  be  marked),  and  the  items  to  be  transferred  are  named  and  may  also  be 
annotated. 


3.4  Detailed  analysis  of  a  protocol 

Let  us  now  see  how  the  system  for  coding  the  planning  protocols  can  be  applis.j 
to  the  full  protocol  given  by  a  planner  for  solving  one  planning  problem.  The 
analysis  of  one  planning  protocol  is  given  in  Table  III.  The  second  column  in  the 
table  contains  the  verbal  protocol  of  the  planner,  chunked  into  sections  that  are 
numbered  for  reference  in  the  description  below.  The  third  column  contains  the 
graphical  protocol  (gestures  and  drawing)  that  was  executed  concurrently  with 
the  verbal.  A  legend  giving  the  meaning  of  the  graphical  actions  is  provided  at 
the  end  of  the  table.  The  map  in  Fig.  3  will  also  assist  in  interpreting  the 
graphical  activity.  The  map  is  a  copy  of  the  planning  board  showing  the  annota¬ 
tions  made  by  the  planner  (items  marked,  routes  drawn,  etc.)  and  labelling  the 
squares  that  are  referenced  in  the  graphical  protocol.  Thus,  in  phrase  26  of  the 
protocol,  the  planner  proposes  that  the  blue  robot  should  "go  first  through  here 
to  pick  up  the  melons,  the  wax,  the  pineapples"  and  at  the  same  time  gestures 
("scopes")  the  area  around  square  "a"  on  the  board,  and  then  draws  route  "B2",  a 
route  intended  for  the  blue  robot. 

The  remaining  columns  in  the  table  show  the  plan  action  codes  applied  to  the 
planning  activity.  The  core  of  the  planner’s  activity  is  devoted  to  actually 
developing  a  satisfactory  plan  (in  three  levels  of  detail  as  discussed  above).  A 
Preplanning  phase  is  devoted  mainly  to  orientation  on  the  problem  requirements 
and  the  store  layout  and  a  Postplanning  phase  focusses  on  consolidating  the  final 
plan. 


PROTOCOL  _  I _ _ PLANNING  ACTIONS _ _ 

AL  I  GRAPHICAL  I  PREPLAN  I  LKVEL  1  |  LEVEL  2  |  LEVKL  3  1  t  POSTPLAN 


Fig.  3  Graphical  map  for  sample  protocol. 
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In  ’this  plaraiing;  protocol,  the  ,pj^er<tbegins  by  marking  the.  locations,  .of,  .the 
items  given.in  the;shopping  listfon  the.stcretiaybut.  She;  them  notes  theaesources 
available  ("two  robots",  in  phr^e  7).  She  adopts  the  general  strategy  that  the 
robots  should.tihoveisimultarie6usly>^smuch; oft the.:time  ^  ppssible^and jthatuhe 
red?;sKduld  move-as  directly.^as:possible  fromnhe;  IN  to, ;the,  0,tJT '(phrases '8-9). 
In  phrases4lO:ahd’H;i  theipossibiUty-ofta^tramfer  event. is'mentioned;-, Since  the 
event-is  ;simply  ■  proposed,  and  xnbt.'giVendn:aity  detail, ,  the  level.<pf  plan'  detail  .  at 
this  stageds  rough  and ’.spahe  . action  ;is  assigned  fto* Level  1..  .The  rules  are ithen 
translateddrito  mfomi  that  applies  tdnhisf particular ’layouU.(iie,,  "theiyo^rt  and; 
the  butter  have  to  be  picked^  updater?);  The  hile^^rahcefning  bakedsgoods  seems 
to  sprompt  -the  detailed  construction,  in,phfase  18,  fpf.ithe;  l^t  part  of  the  .blue 
robot’s  .route,  labelled  "Bli'  on  the  graphical' map.- Since  the  route,  is.  actually 
drawn  out,  the  action  is  assigned  to  Level  3;  The  planner  then  turns  in  phrase  20 
to  consideration  of  the  transfer  itself,  proposing  that  it.  should  .happen  "around" 
the  square  labelled  TPl.  The  use  of  the  qualifier  "around"  indicates  that  this 
specification’ of  .transfer  location  is  only  approximate,  and  so  the;  planning  action 
iS’ coded  at  Level  2.  A*  possible  route  fragment  for  blue  is  considered  briefly 
(only  verbally)  and  rejected. 

In  phrase  24,  the  planner  changes  focus  to  the  red  robot  and  constructs  a  route 
(Rl)  down  the  aisle  from  the.rIN.  She  starts  by  assigning- the  pickup  of  wax  and 
melons  to  red  and  then  modifies  the  assignment  so  that  blue  picks  them  up 
instead.  Assignments  of  items  by  name  are  coded  at  the  most  detailed  level  of 
planning  (Level  3).  The  planner  continues  to  work  at  this  detailed  level;  first 
drawing  route  B2,,  then  R2;  then  fixing  a  transfer  point  at;  location  TPl  and 
finally  constructing  blue’s  route  after  the  transfer  (B3)  to  pick,  up  the  drinks  (in 
phrase  .29).  A  problem  arises,  because  the  planner  still  has  in  mind  a  second 
transfer  after  blue  picks  up  the  drinks,  but ;blue  cannot  transfer  drlnks  on  top  of 
the  items  in  red’s  basket.  As  it- happens,  she  has  a  solution  for  this  situation 
(from  previous  sessions);  she  proposes  a  transfer  of  all  goods  ifrom'’red  into  the 
blue  basket,  and  then  the  reverse,  where  the  drinks  are  selected  to  be  trans¬ 
ferred  first’.  This  move  satisfies  the  rule  concerning  drinks  always  being  oh  the 
bottom  of  the  basket.  There  is  yet  a  further  problem,  thatfhe  times  taken  by  the 
two  robots  to  move  to  the  second  transfer  are  unequal  (noted  in  phrase  35),  thus 
leading  to  inefficiency  in  the  use  of  resources,  since  one  robot  (the  red  in  this 
case)  would  have  to  wait  for  the  other.  No  solution  to  this  problem  is,  proposed 
at  this  point  (phrase  36)  and  the  planner  goes  on  to  epthpute  the  number  of 
items  remaining  to  be  picked  up  after  the  second  transfer. 

It  appears  in  phrase  38  that  planning  has  stalled,  and  the  planner  goes  back  to 
review  the  plan  so  far  and  to  consider  the  time  it  would  take  for  the  robots  to 
execute  their  paths  (in  phrases  41-56).  To  solve  the  problem  of  unequal  route 


’  The  other  planner  in  this  study  did  not  discover 


this  tactic. 
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times  ;after  the. firsts  transfer;  a  balancing' of  .the  plan' is  made-in  phfase,54;  fed  is 
assigned  piclcupiof  the:hagel.  This  Balancing* is  dohe  at  a  fine  level  of  detail; 

In  thedastipart  of'the  plan;constnicti6n,'the.decision  is  made-.to  have;red  go  up 
fof4he.  pork:cK6ps-andiroast  beef,  whUe  bliie.gets  the  dairy  products  and  baked 
goods;  Elanning«;is;done  in{two  stages;;firstia'.tehtative  last  routefrag.(R4)  for  red 
is.drawriirusing  dots  (in  phrase:64),  and  the  tiine  iof  it -measured.  This  planning  is 
at  Leyel.  2,  .  since- the -route  is  mot 'firmly  established.  Then  the  time  for.  the  last 
part  of  blue’s  routes  (the  portion  between  s  the  square  TP3  and*  the,  pickup  point 
for.  the 'butter  at 'the^beginning  of  Bl)  is  measured^  (in.  phrase  68).  Although  the 
two-afemot-quite  equal,  red  taking  17‘ticks  and  blue  only  14,  the  subject  accepts 
those  routes.  The  session  doses  with  a  firm  cohstructiomof  the  route  B4' and  R4, 
arid  a  redrawing  of  the 'rest  of  the  route;  for  blue,  as  consolidation.  These  actions 
occur  as  part  of' a  Postplan  phase. 

The  coding  of  the  protocol  shows  that  there  is  a  gradual  deepening,  from  Level  1 
to  Level  3,  of  information  considered  in  the  planriing  process  and  a  concurrent 
detailing  of  the  plan  itself. 


3.S  Preliminary  observations  on  planning  behavior 

The  two  planners'  in  this  study  took  between  5  and  15  minutes  to  plan.  Both 
began  planning  by  marking  the  items  from  the  shopping  list  on  the  store  layout 
and  briefly  reviewing  the  rules.  Subsequent  planning  was  done  primarily  by 
sketching  proposed' routes  out  with  red  and.  blue  pencils  (corresponding  to  the 
routes  for  the  red  and  blue  robots).  Planning  did  not  necessarily  follow  a 
welhorganized  procedure,  especially  in  the  early  problem  sessions,  when  it  was 
characterized  by  fragmented  thought  trains  and  frequent  changes  of  focus.  An 
example  of  this  is  to  be  found  in  the  sample  protocol  (phrases  20-26): 

"one  possibility  is  that' he  meets  the  n;d  robot  somewhere  around  here 
where  he  can  hand  over  the  items 
in  that  case  he  can  continue  ... 
no ... 

um,  if  the  red  one  moves  like  this 

well,  he  could  pick  up  the  wax  and  the  melons, 

but  then  um  maybe  it’s  ... 

maybe  the  blue  one  should  go  first  through  here  to  pick  up  the 
melons,  the  wax,  the  pineapples" 

Early  planning  seemed  to  be  characterized  by  a  search;  for  an  organizational 
structure  upon  which  to  base  the  planning  procedure.  Planning  in  later  sessions 
was  closer  to  the  procedure  that  will  be  discussed  in  a  following  section. 
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The  plaiis  produced  in  this  study -evolved  gradually,  but  it  was'ppssible  tp;identi.fy 
stages  :of  plan^developmenti  corresponding,  to- different  ilevels<pf  plan,  detail 
shown  in,  the: sample  protocol).  Planners  usually  developed  only;  one  plan  and 
made  no  attempt  to  develop  a  second  different- one  for  comparison.  The 
organization  of  the  plan  was  anchored  in  time  and  space  around  the  transfer 
event(s)  and  the  entry  and  exit  of  the  robots.  (A  transfer  was  not  necessarily 
usedrin  each  plan  produced;  however,  some  plans.involved  two  transfers  and  one 
three.)  Plan  development  generally ToHowed  anrexpected  chronological-  order- of 
execution;  so  that  events  expected? to  be  executedTirsfwere'planned  first.  Both 
planners- made-an  early  split  between  the  plan  for  ;the -red,  robot  and.  that  for  the 
blue,  switching  back,  and  forth- to  focus  on  one  and  then  the  other  so  that  the 
plans  for  the  two  were  created  in  parallel. 

An  important  strategy  in  solving  this  planning  problem  is  to  realize  that  red 
should  go  as  directly  as  possible  from  the  IN  to  the  OUT  square.  Since  red 
moves  the  slower  of  the  two  robots,  this  puts  a  lower  bound  on  the  number  of 
ticks  required  to  execute  the  plan  and  reduces  the  size  of  the  solution  space. 
Both  planners  used  this  strategy.  One  planner  eventually  adopted  the  approach 
of  first  counting  the  number  of  ticks  on  the  direct  pathway  from  IN  to  OUT  to 
establish  this  lower  bound.  However,  both  seemed  to  have  some  initial  difficulty 
in  modelling  the  relative  speeds  of  the  robots:  each  expressed  surprise  at  how 
"fast"  the  blue  robot  moved  in  comparison  to  the  red; 

Planners  often  simulated  the  execution  of  proposed  plans  or  plan  fragments. 
Simulation  was  carried  out,  for  example,  via  the  retracing  step-by-step  of 
proposed  routes  on  the  planning  board  with  concurrent  mention  of  which  items 
were  to  be  picked  up.  In  cases  where  the  planner  was  searching  for  a  transfer 
point,  the  focus  of  the  simulation  of  robot  movement  switched  frequently  back 
and  forth  between  the  robots. 

Most  of  the  plans  produced  were  fairly  "complete",  dn  the  sense  that  they  could 
be  executed  without  much  further  detailing  or  change.  Occasionally  the  planner 
stopped  execution  briefly  to  consider  how  to  proceed, -but  this  did  not  result  in  a 
change  in  the  original  plan,  only  an  amplification.  In  three  of  the  sessions 
studied  in  detail,  the  planner  discovered  errors  in  the  plan  during  the  execution 
phase,  and  this  resulted  in  replanning.  In  one  case,  the  planner  had  neglected  to 
pick  up  an  item.  In  another  case,  the  plan  had  not  been  completed  during  the 
planning  phase;  it  seemed  that  the  planner  could  not  see  how  to  efficiently 
resolve  the  pickup  of  one  item  near  the  end,  and  had  decided  to  execute, 
possibly  in  the  hope  that  the  problem  would  be  clarified. 

How  "good"  were  the  plans  that  the  two  planners  created?  We.  gave  a  subset  of 
the  problems  used  in  this  study  to  two  experts  who  had  solved  several  similar 
versions  in  a  previous  pilot  study.  They  were  asked  to  spend  as  much  time  on  the 
problems  as  necessary  to  produce  the  best  solution  (i.e.,  to  minimize  the.  number 
of  ticks).  On  average,  the  solutions  produced  by  these  experts  were  around  26 
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ticks.  The  two  planners  in-  this  study  averaged  about  30  ticks,  although  some 
solutions  were  considerably 'longer,. especially  if  the  planner  had  made  an  error. 
Howevei;’  the  plans -produced  by  the  two  planners  for  a  given  list  and  layout 
were  aliripst  never  the  same  in^terins  of  the  routes ^followed  by  the  robots  and 
the  assignmeht  of  items-to  the  robots  for  pickup. 

Plan  actions  intended  to  be  executed  at  the  beginning  tended  to  be  developed  in 
more;  detail  than  those  fon  the  end;  of -the;  plan.  Notable  also  was  the  fart’that  the 
two  planners  ^differed  . in' the  degree  in- which  they  detailed;  out  the  final  plan  on 
the  planning  board.  One' planner  was  satisfied  with  a  simple  drawing  out  of;the 
robots’  routes;  the  other  marked,  in- addition,  route  directions  .(with  arrows), 
pickup  points  for  items  and  the  transfer  point(s).  Both  planners  monitored 
execution  by  marking  off  the  items  on  the  planning  board  as  they  were 
picked  up. 


4  DISCUSSION 
4.1  Planning  behavior 

The  SPLITS  paradigm  as  used  in  this  study  worked  very  well  in  evoking  and 
capturing  the  planning  behavior  of  the  planners.  The  planning  problem  was  hard 
enough  that  the  solution  was  not  obvious,  but  not  so  hard  that  planners  could 
not  find  a  plan  (albeit  in  most  cases,  not  the  best)  in  a  reasonable  time.  The 
procedure  of  using  12  sessions  gave  the  planners  opportunity  to  learn  and  to 
explore  different  strategies  for  solving  the  planning  problem. 

The  planning  behavior  exhibited  by  planners  in  this  study  can  be  characterized 
as  a  search  for  a  solution  (a  plan)  that  accomplishes  the  goal  and  satisfies  the 
constraints  of  the -problem  statement.  However,  this  search  was  not  a  process  of 
simply  selecting  potential  (finished)  plans  and  testing  them  against  the  criteria. 
Rather,  platmers  developed  the  plans  in  an  evolutionary  manner  by  transforming 
the  information  presented  in  the  problem  statement  using  the  representation  on 
the  planning  board;  Continually  during  the  process  of  planning,  planners  seemed 
to  be  lobking  for  ways  of  efficiently  organizing  and  prioritizing  the  information 
they  needed  to  consider  so  that  a  good  solution  would  be  discovered  without 
overload  of  their- limited  processing  and  memory  capabilities. 

It  took  time  for  planners  to  develop  ways  of  structuring  and  decomposing  the 
problem.  Methods  for  organizing  the  information  and  procedures  for  manipulat¬ 
ing  it  were  discovered  and  refined  during  the  course  of  the  sessions.  For  exam¬ 
ple,  both  planners  decided  to  split  the  development  of  the  plans  for  red  and  blue 
early  in  the  planning  procedure.  Tliey  established  ways  to  handle  the  spatial 
aspects  of- the  plan  (e.g.,  via  representations  of  routes  on  the  planning  board) 
and  the  temporal  aspe  :ts  of  the  plan  (e.g.,  by  dividing  the  plan  into  phases 
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anchored -on  the  stransfer  event);  Further,,.they,  devised -  ways  to  co-ordinate  the 
spatial-  and -temporal. aspects  of  plan-  development:  by,  for  example,  thei  counting 
of  ticks  for  the.jtravelling^of  a  routei,and;  then-the^establishment  of  a?  transfer 
location;  ,  They  discovered  .which  information  was  critical  for  the  viability/ of- the 
plM  (the  rules  conceming  position  of  drinks, andrbaked;goods  in?the  basket)  and 
which  was  not.  Furthermore  they  learned  procedures  to  guide  the  order  jn  which 
this  information  was  considered. 

There  were  a  variety  of  planning  strategies  exhibited- by  planners.  .Some  per¬ 
tained  to  the  best  use  ;pf;  the  environment  available,  for  planning  ;(the  planning 
board)  at  a  somewhat,  mechanical;  level.  The  planners  considered,  for  example; 
how  to  use  the  colored  pencils;  what  codes  should-bemsed. for  marking  items  to 
be  picked  up;,  whether  and- how  to  annotate  the  number  of  ticks- required  ,  for  a 
route;  when  to  take  a  second  planning  board.  Some  strategies  pertained  to 
choosing  a  good  general  criteria  for  a  solution,  thus  guiding  the  top-down  search 
for  a  plan.  For  example,  both  planners  attempted  to  find  a  plan  in  which  the  red 
robot  went  as  directly  as  possible  from  IN  to  OUT.  .More,  detailed  strategies 
concerned,  for  example,  the  selection  of  the  best  pickup  points  (of  two  or  three 
possibilities)  to  minimize,  at  a  Iqcal  level,  the  distance  travelled  by  a  robot. 
Unfortunately,  subjects’  verbal  protocols  did  not  often  mention  the  strategies 
that^  they  used,  and  so  they  need  to  .be  inferred.  The  issue  of  strategies  for- 
planning  is  a  topic  that  should  be  investigated  in  more  detail. 

One  factor  that  may  have  a  significant  influence  on  the  way  that  planners 
structured  their  soiutions  to  the  planning  problem  is  the  manner  in  which  they 
were  ti'ained  in  the  first  three -sessions.  In  the  training  sessions,  planners  received 
three  simpler  problems  that  focussed  on  aspects  of  the  more  complex  problem 
solved  later.  In  the  first  training  problem,,  planners  dealt  with  only  one  robot;  the 
second  training  problem'  used  the  first  -as  a.  basis,  and  introduced  the  basket 
constraints;  in  the  third,  planners  were  required  to  co-ordinate  two  robots,  but 
were  not  required  to  deal  with  .the  constraints.  The  specific  substructuring  of  the 
planning  problem  suggested  by  the  training  sessions  may  have  pre-disposed 
planners  to  decompose  the  more  complex  problem  in  the  same  way.  Further¬ 
more,  in  training,  planners  were  already  adopting  strategies  and  methods  for 
solving  the  more  complex  shopping  .problem.  TTiis  study  did  not  take  account  of 
these  previously-developed  approaches  and  strategies.  We  propose  that  a  future 
experiment  should  focus  on  hqw  people  solve  this  planning  problem  without 
training. 

Another  important  finding  in  this  study  was  that  planners  attended  to  different 
levels  of  detail  of  information  in  planning.  Furtherniore,  plans  themselves 
seemed  to  be  developed  at  different  levels  of  detail.  Sometimes,  concepts  used  in 
planning  were  discussed  at  a  gross  level  of  spatial  or  temporal  detail  (e.g.,-  the 
top  and  bottom,  of -the  store;  before  or  after  the  transfer  event);  at  other  times,  a 
relatively  fine  level  of  detail  was  manipulated  (e.g.,  specific  squares  for  the 
transfer  of  items,  detailed  ordering  on  their  pickup).  Our  analysis  identified 
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three  levels  of  detail 'in  planning.  It  would  be  useful,  to 'have  this  estimate 
confirmed;  .possibly  by -the  planners  themselves.  The  protocols -further"  showed 
that  there  was  a*  general  progression-frbni  themse  of  gross  information  to  the  use 
of 'detailedjinformatioh ‘during  the  course;  of *plan  development".  However,  there 
was  a  great  deabof  variability  im  this  progression  as  can  be  seen  in  the^sample 
protocol. 

Planning  in  this  task  was  also  characterized  by  repeated  simulation  of  the 
proposed '^plah  of  plan  fragments.  A  difficulty^fbr  planners -in  simulating  execu- 
.tion’stemmed  .from  >that  fact  that  the 'bvo  robots  moved  simultaneously;  it  was 
hard  to  keep-  track  of  ' where  each  was  as  the  simulation  proceeded;  Planners 
resorted  .to  simulating -first  the  movement  of  one  robot  (for  a  short  period  of 
time)  and  - then  the  other.  The  simulation;  of  execution  seemed  to  aid- planners  in 
clarifying  the  state  of  the  robots  at  a  point  in  time  and  in  reviewing  the  final 
plan. 

The  product  of  the  process  of  planning  is  the  plan  itself.  It  is  the  planner’s 
mental  concept  of  how  the  robots  must  move  and  carry  out'  the  pickup  of  items 
so  that  the  goal  is  satisfied.  It  is  what  the  planner  intends -should  be  executed. 
The  planning  board  served  as  an  a  sort  of  extended  memory  for  the  planner,  a 
place  to  record  the  plan  so  that*  it  could  be  used  to  guide  execution.  Both 
planners  formulated  their  final  plan  as  two-routes,  one  for  red  and  one  for  blue, 
with  the  items  to  be  picked  up  indicated.  In  addition  to  the  plan  itself,  the 
planning  process  also  resulted  in  intermediate  products  ••  fragments  of  routes, 
partitions  of  items,  proposed  transfer  areas  -•  that  were  manipulated  in  the 
process  of  planning.  For  example,  partial  routes  for  the  robots  were  con-structed 
by  both  planners  and  then  manipulated  (e.g.j  erased,  annotated);  potential 
transfer  points  were  marked.  These  intermediate  products  could  be  considered 
working  plans  or  working  plan  fragments.  This  study  gave  only  an  indirect 
indication  of  the  planners’  mental  representation  of  plans  ahd  working  plans.  It 
is  also  possible  that  the.se  representations  were  influenced  by  the  planning 
environment  in  which  the  planners  worked. 

The  planning  environment  (i.e.,  the- planning  board)  provided  a  convenient  way 
of  representing  the  spatial  aspects  of  the  plan,  and  thereby  the  intermediate 
products  of  a  spatial  nature.  It  did  not-provide  a  convenient  way  of  representing 
the  temporal  aspects  of  the  evolving  plan:  planners  seemed  to  have  difficulty 
co-ordinating  the  two  robots  in  time.  TTie  nature  of  planning  environment  has  a 
major  influence  on  the  ease  with  which  the  intermediate  products  of  planning 
can  be- represented,  and  thus  may  also  have -a  conridefable  effect  on  the  process 
ofiplanrung  itself.  In  a  sense,  this  influence  is  unavoidable;  it  is  virtually  impossi* 
ble  for  planners  to  produce  a  plan  for  a  problem  as  complex  as  this  one  is 
without  some  extenial  way  of  representing  and  manipulating  the  concepts.  It 
would  be  trorthwhile  to  deliberately  vary  the  planning  environrnerit  to  study  the 
effect’ on  the  planning  process, 


We  have  mentioned  that  there  are  different  degrees  of  detail*  of  .information 
considered  in  planning  and  that  working  or  intermediate  plans  seem  to  be 
developed  in/yaryihg;levelS50fidetail.  Althoughut  was:  not  an-overalltxharacteris- 
tic  of  the-plans  developed  in.this;study,.<it  is  also  possible;that  the.'finalplan  for  a 
particular  problein  might  :  be  developed- to  a  lesser  detail  by  one  iplanner  than 
another.  :In  the  paradigm^ chosen  for nhis  study,  planners :  are  not'iforced  to  plan 
tO'.a  certain  level  of >  detail,  per  se.  Nor  are- they  under  aiqr  time  constraint.  They 
are  individually  free  to^stop  the  planning  phase  and  begin  execution  when  they 
are  satisfied  with  their  plans.  ITiereris  a  tradeoff  between- effort  devoted  to 
planning,  and  thus  the  completeness  of  the  plan,  and  the  .effort  needed,  for 
execution.  A  planner  could  stop  planning  early,  with  a  relatively  incomplete  plan, 
and  devote  extra  effort  "on  the  spot-  during  execution  to  maWng.  small  changes 
or  to  developing  further  the  details  necessary  for  execution  (actually  a  form  of 
further  planning).  This- kind  of  behavior  was  occasionally  observed  in  this  study. 
However,  premature  termination  of  plan  development  during  the  planning  phase 
puts  the  planner  at  risk;  it  may  turn  out  that  the  plan  is  not  successful  because 
all  aspects  and  interactions  had  not  been  considered  fully. 

Occasionally,  plans  made  by  the  planners  in  this  study  failed  in  some  way  during 
execution  and  replanning  was  necessary.  It  was  not  always  clear  whether  the 
requirement  for  replanning  resulted  from  a)  incomplete  planning  during  the 
original  planning  phase,  resulting  in  the  planner  overlooking  some  critical  detail; 
b)  a  error  in  planning,  for  example,  a  misconception  about  the  way  that,  robots 
behave  in  the  store,  or  a  miscalculation  in  timing;  c)  inadequate  annotation  of  a 
plan  that  was,  in  fact,  completely  developed,  resulting  in  faulty  execution  (e.g., 
the  planner  "forgot"  to  pick  up  an  item,  although  intending  to).  This  issue 
deserves  further  investigation. 

Finally,  it  is  noteworthy  that  the  planners  in  this  study  did  not  deliberately 
consider  alternative  plans  for  solving  a  problem;  typically  they  developed  only 
one  plan  which  was  then  executed.  This  is  somewhat  surprising,  since  the 
planners  had  no  a  priori  criterion  for  judging  . the  goodness  of  a  particular  plan 
(in  terms  of  the  number  of  ticks- it  cost);  one  might:  expect,  therefore,  that  they 
would  want  to  compare  two  or  more  different  plans  (for  a  given,  problem)  in 
order  to  determine  the  one  with  the  minimum  number  of  ticks.  Presumably, 
though,  planners  were  satisfied  with -developing. criteria  for  the  goodness  of  the 
plan  through  feedback  during  its  execution.  Perhaps  it  cost  too  much  cognitive 
effort  for  planners  to  develop  and  compare  different  plans  for  a  problem. 
Limitations  in  the  flexibility  of  the  planning  environment  might  also  be  a  factor; 
The  planning  board  did-  not  facilitate  backtracking  in  planning  to  permit  consid¬ 
eration  of  alternatives.  Furthermore,  it  was  not  easy  for  planners  to  store, 
recover  and  compare  alternative  plans. 

Although  this  discussion  has  pointed  to  a  number  of  characteristics  of  planning 
behavior,  it  should  be  emphasized  that  they  are  based  on  preliminary  observa¬ 
tions  of  only  two  planners. 
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42  Analysis  method 

The  protocol  analysis  method  adopted;  for  this  .study;  permitted  us  to  consider 
step-by-step  the  plahhefs’  ^processing  of'  information  during  planning.  The 
analysis<.carned-  out  ;in-this  study  resulted'uni  the  identification  of  a  set  of  plan 
actions  that;describeimost  of  the  rovert  activities  of  the  planners,  as  reflected-in 
the'  verbal  and  graphical  protocols.  In  .particular,  the  videotaping  methodology 
and  analysis ‘ofvgraphical  interactioiK  with,  the  planning 'board  permitted  . us  to 
address^the  manipulation'  of  spatial  :information:that  is’  a  fimdamental  component 
of  planning  in- this  problem. 

It  is  very  likely  that  the  plan  action  set  for’ this  problem  is  incomplete,  since  it 
was  developed/  using  only  the  protocols  of  two  planners.  Further  studies- with  a 
wider  range  of  planners  will  indicate  whether  it  needs  to  be  extended  and 
refined. 

One  problem  in  using  the  plan  action  set  for  coding  of  concurrent  verbal  and 
graphical  protocols  is  that  it  is  often  difficult  to  determine  a  unique  code  for 
each  chunk  of  the  protocol.  In  this  study,  chunking. of  the  protocol  for’analysis 
was  done  by  focussing  on  phrasing  in  the  verbal  protocol;- the  graphical  protocol 
was  then-  added  alongside,  in  the  form  of  an  adjunct.  However,  at  times  the 
concurrent  verbal  and  graphical  protocols  suggest  that  planners  were  executing 
planning  actions  simultaneously,  for  example,  concurrent  route  creation  (graphi¬ 
cal)  and  assignment  of  items  to  be  picked  up  by  the  robot  (verbal).  In  these 
instances  two  codes  have  to  be  assigned.-  It  is  difficult  to  find  a  chunking  of 
verbal+graphical  that  solves  this  problem,  since  the  graphical  protocol  is  closely 
coupled  to  the  verbal;  for  example,  it  often  also  serves  to  clarify  the  diectlc 
references  (e.g.,  "this",  "those")  in  the  verbal  protocol. 

The  analysis  method  was 'laborious  and  very  time  consuming,  especially  the 
coding  of  the  graphical  protocol.  It  required  many  iterations  to  develop  the 
object  and  concept  vocabulary  and  the  plan  action  codes.  Computer-based' tools 
or  an  environment  for  handling  and  coding  videotaped  data  of  this  sort  would  be 
very  helpful  in  facilitating  the  coding  process  and' ensuring  its  consistency. 

A'deficiency  in  the  format  developed  for  coding  the  protocols  is  that  we  have,  as 
yet,  mo  way  of  notating  the  intermediate  states  of  the  plan  (the  working 
plan/plan  fragments)  alongside  the  plan- actions.  A  record  of  the  state  of  the 
plan(s)  as  it  has  been  developed  by  the  planner  to  that  point  in  the  protocol 
could  be  helpful  in  uncovering  errors  in  planning.  We  have  experimented  with 
one  graphical  notation  system  and  will  continue  to  search  for'a  suitable  notation 
system. 


4.3  A  hierarchical  model  for  efficient  planning 

In  this  section,  m  propose,  a  hierarchic^  niodel.  of  planning  for  this  task  that 
takes  account  of  the  observations  of  planners’  behavior  made  in  conjunction  with 
the  analysis.  However,  the  model  is  idealized,  in  the  sense  that  it  describes  what 
we  believe  to  be  an  "efficient"  planning  procedure,  one  that  experienced  planners 
might  adopt.  An  efficient  procedure  for  planning  organizes  the  treatment  of  the 
problem  and  guides  the  search  for  a  solution  in  a  way  that  there  is  a  high 
likelihood  that  a  successful  plan  will  have,  been  found  by' the  end  of  the  proce¬ 
dure.  A  suitable  organization  (subdivision)  of  the  problem  is  necessary  because 
humans’  limited  cognitive  processing  cannot  manage  the  full  range  of  detail  and 
interactions  that  needs  to  be  considered  simultaneously  in  planning  problems  of 
this  kind.  Thus  an  efficient  procedure  minimizes  the  work  that  the  planner  must 
do  to  create  a  successful  plan  for  the  range  of  circumstances  expected.  An 
efficient  procedure  does  not  guarantee  that  a  successful  plan  will  be  created 
after  a  given  amount  of  work,  but  it  raises  the  probability  that  it  will. 

Hierarchical  models  of  planning  propose  that  the  process  of  planning  is  tightly 
linked  to  a  hierarchy  of  plan  representations  at  different  levels  of  abstraction 
(degrees  of  detail).  In  hierarchical  planning,  the  planner  creates  increasingly 
more  detailed  plans  in  successive  phases  of  the  planning  procedure.  The  hierar¬ 
chical  approach  also  advocates  that  in  cases  where  the  problem  cannot  be 
cleanly  subdivided  into  independent  subgoals,  that  a  complete  plan  be  produced 
at  a  given  level  of  detail  before  planning  at  the  next  level  of  detail  is  started. 
Planning  is  continued  until  a  plan  of  "sufficient"  detail  has  been  produced. 

There  is  evidence  from  analysis  of  the  protocols  in  this  study  that  planning  is 
carried  out  at  varying  levels  of  detail:  three  levels  have  been  identified  in  the 
protocols,  as  described  in  a  previous  section. 

The  planning  protocols  show  an  identifiable  sequence  of  steps  that  ■’re  followed 
in  solving  this  planning  problem.  Planners  seem  to  use  a  core  procedure  in  which 
they: 

1.  Orient  on  the  specific  resources,  rules  and/or  layout  given  in  the 
problem  statement; 

2.  Adopt  a  strategy  for  creating  a  plan  or  plan  fragment,  making  deduc¬ 
tions  about  necessary  plan  characteristics  based  on  the  analysis  in 
step  1; 

3.  Create  a  working  plan  by  applying  specific  and  general  strategies; 

4.  Evaluate  the  plan  to  ensure  it  satisfies  all  rules  and  constraints; 

5.  Decide  whether  to  accept  the  plan;  if  not,  go  back  to  modify  the 
working  plan,  or  to  create  an  entirely  new  plan. 
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Notes: 


can 


PREPLAN 

Orient  on  problem  requirements 

Note  general  problem  requircmcnls 
Note  resources  and  characlctisucs 
Note  criteria  of  solution 


Adopt  general  strategy  for  problem 

'Deduce  very  general  plan  characteristics 


Transform  representation  of  problem 
Mark  items  on  layout 


LEVEL  1  PLAN  CREATION 

Note  rules  concerning  drinks,  b^ed  goo^* 

Translate  rules  for  particular  layout:  spccilic  ilems,  spaual  location 
Make  further  transformation  of  representation 

Deduce  plan  charxtcrislics  from  baked  fu'^ocauon 
Deduce  plan  characteristics  from  dairy  rule/location 

Create  very  rough  Plan  •  PI 

Makc/modify  PI  for  one  robot 

choose/modify  very  rough  assignmcnVTOUlc 

Makc/modify  PI  for  other  robot 
Determine  number  of  transfers  needed  (if  any) 


[Evaluate  PIl 

Check  against  rules 

??Accept?? 

??Enough  detail??  - 


♦  END 


continued..’ 


Fig.  4  An  efficient  procedure  for  executing  the  planning  task. 
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Figure  4:  continued 


LEVEL  2  PLAN  CREATION 

Orient  on  whole  layout  .  ■  ,  j 

Form  rough  groups  or  partitions  of  items  to, be  picked 
Note  any  spatial  "orphans" 

Adopt  strategy  based,  on  layout 

Deduce  plan  characteristics  from  grouping  of  items 

Create  Cy  pjjy,  yp  jq  transfer  event  (P2  IP  A)  for  one  robot 

adept  sttaie^ 

_ ^  choose/modity  rough  routc/ajsignment  (based  on  PI?) 

L 1  evaluate  against  basket  capacity 
??acccpr?? 

(mcasurc/compulc  route  limes) 

L  Deduce  implications  of  P2toA  so  far  for  other  robot 

‘ —  ??Reasonablc??  ™  .s  r  .i, 

r>  r-*-  Makc/modify  rough  plan  up  to  transfer  event  (ELlslA)  for  other  robot 

Evaluate  E2J£LA  on  equal  route  ticks  for  robots 

llL  ??Acccpt?? 

Specify  transfer  arca/cvent 

(Deduce  implications  of  EZJtLti  for  plan  after  transfer  event] 

[->  Makc/modify  rough  plan  after  transfer  (P2  aficr..ti)  for  one  rot 

Uj  Dwlucc  implications  ofEZjfifiLA  so  far  for  other  robot 

"J=  ??Rcasonablc?? 


5  robot 


VVRcasonablc.'/  ^  _  ,  .  . 

Makc/modify  rough  plan  after  transfer  (.P2  aflcil^)  for  other  robot 
L  Evalu  itc  P2  after  A  on  equal  route  ticks  for  robots 
i=  ??Acccpl?? 


[extend  in  the  case  of  more  than  one  transfer] 

Evaluate  P2 

(Check  against  rules] 

Check  all  items  pick^ 


??Accept?? 
??Enough  detail?? 


POSTPLAN 


from  LEVEL  3 
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Figure  4:  continued 


LEVEL  3  PLAN  CREATION 

Orient  on  relative  location  of  items 

Adont  strategy  based  on  item  location  r-,  „ 

Deduce  plan  charactcrislics  from  rcialive  locations  of  items 

Create  detailed  Plan  -  P3 

-♦  Make/modify  detailed  plan  P3  tO-A  fof  o''®  robot 

detailed  route/assignment  (based  on  P2) 
evaluate  against  basket  capacity 
(mcasuie/computc  ticks] 

??ac£cpt?? 

Deduce  implications  ofP3toA  so  far  for  other  robot 
Specify  potential  transfer  point 
(-►  Makc/modify  detailed  plan  EIklA  for  other  robot 
Evaluate  P3  to  A  on  equal  route  ticks  for  robots 
??Acccpt?? 

Tunc  P3  to  A  on  ticks 

adjust  transfer  point  or  modify  assignment/route 
??acccpt7? 

Specify  transfer 

fix  transfer  point 

fix  number/type  of  items  to  be  transferred 

Deduce  implications  of  on  P3  aflCf-A 
=  ??Acccpt^  ^  ^  ^  for  one  robot 

Deduce  implications  ofP3  after  A  so  far  for  other  robot 

measure  no.  remaining  items 

I  r-»  Make/modify  detailed  plan  P3  afler  A  for  other  robot 
L ,  L,  Evaluate  P3  after  A  on  equal  route  ticks  for  robots 
1=  ??Accept?? 

Tune  P3  after  A  on  ticks 
- ??Acccptable?? 

[extend  in  the  case  of  more  than  one  transfer] 

Evaluate  P3 

(Check  against  rules] 

(Check  all  items  picked] 

Check  total  time  satisfactory 

??Accept?? 
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POSTPLAN 

Consolidate  Plan 

join  plan  parts  together 
Redraw  routes 

Specify  (mark)  pickup  points,  route  direction 

Review  entire  Plan 

Check  all  rules,  conditions  satisfied 
Replay  plan 


END 


This  core  procedure  is  invoked  repeatedly  during  planning,  and  can  be  detected 
at  both  micro  arid  macro  levels. 

By  coupling' the  notion' of  levels  of  ' plan  detail  with  the  core  procedure  for 
planning  described  above,  we  can  create  a  plausible  model  for  efficient  planning 
based  on  hierarchical,  top  down  development  of  the  plan.  The,  model  is  given  in 
detail  in  Fig.  4.  The  model  proposes  that  planning  in  the  shopping  problem  is 
efficiently  accornplished  by'^proceeding  through  S^phases: 

a)  PREPLAN^ 

b)  LEVEL  1  PLAN  CREATION, 

c)  LEVEL  2  PLAN  CREATION, 

d)  LEVEL  3  PLAN  CREATION,  and 

e)  POSTPLAN. 

Each  phase  has  a  number  of  steps  associated  with  it,  that  are  themselves  broken 
out  into  substeps  at  two  further  levels.  Thus  the  process  itself  is  described 
hierarchically.  TTie  core  activities  of  orientation,  adoption  of  strategy,  create 
plan,  and  evaluate  (and  possibly  modify)  occur  three  times,  against  three  levels 
of  detail  of  information  resulting  in  plans  of  increasing  detail  (PI,  P2,  and  P3). 
At  the  end  of  each  phase  of  PLAN  CREATION,  the  planner  has  the  option  of 
terminating  plan  development  if  it  is  felt  that  the  level  of  detail  is  sufficient  (at 
the  step  ??Accept??),  in  which  case  subsequent  plan  creation  phases  are 
bypassed.  The  diagram  suggests  that  PLAN  CREATION  is  carried  out  as  a 
linear  sequence  of  major  steps  in  which  first,  a  rough  plan  is  created;  and  then, 
two  more  plans  of  increasing  detail  based  on  that  initial  rough  plan  are  created. 
However,  backtracking  to  PLAN  CREATION  at  the  previous  level  of  plan  detail 
can  and  does  occur  when  the  plan  developed  at  the  higher  level  of  abstraction 
proves  to  be  unworkable  at  the  next  lower  level. 

Prior  to  the  phases  of  PLAN  CREATION  is  a  phase  of  PREPLAN,  where  the 
planner  "sets  up”  for  the  problem,  noting  general  problem  requirements  and 
resources,  adopting  some  general  approach  to  planning  (e.g.,  using  the  colored 
pencils  to  draw  routes)  and  doing  other  preparatory  work  like  marking  the  items 
to  be  picked  up  on  the  layout  of  the  store.  There  is  also  a  POSTPLAN  phase 
which  serves  as  preparation  for  execution  of  the  plan:  plan  fragments  are 
consolidated  and  otdered,  a  final  check  is  made  that  the  rules  are  satisfied  and 
the  plan  may  be  replayed  in  its  entirety.  The  plan  on  the  board  is  often  annotat¬ 
ed  in  more  detail  to  ensure  correct  execution. 

Let  us  consider  now  the  actual  Create  Plan  step  that  itself  forms  the  kernel  of 
activity  in  each  level  of  PLAN  CREATION;  In  Level  1,  this  step  is  short,  and 
consists  most  often  of  simply  making  a  very  gross  partitioning  of  the  items 
between  robots,  or  selecting  rough  routes  for  each  robot  to  follow.  A  key  step  is 
to  determine  whether  or  not  a  transfer  is  needed. 
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At  the  next  ileveb  of  plan  detail.  Level  2,„plan  creation  is  rguided  by  the  plan 
developed  at  Level  1.  The  transfer  event,  if  it  :has  been  (proposed;,  plays  an 
important  role  m  structuring  the  process.  The  plaimers  were  observed  to  first 
make^a^rough  plan  for  one- robot  up -'to  the  transfer  event '(denoted  as  <:'!>  in 
the  .figure),  that  is,  to'.-select  an  assignment>or  . routing  for  one  robot... Often  the 
assignment/routing.  is  checked  to  ensure'  that  it  -does  not  cjcceed  the  basket 
capacity  *  of  the  robot,  and  tspmetimes  a  tough  estimate  is  madeiof  the  cost  (in 
ticks)  of  a  proposed  route; ..In  the  next, step,  the  implications  of  this  selection  for 
the  other  robot  are  deduced  (i.e.,  Can  a  second  route  be  chosen  that  puts  the 
second  robot  in  about  the  same  location  as  the  first  at  the  time  of' the  transfer 
event?)  If  the  implications  are  found  to  be  "reasonable",  in  the  sense  that  the 
planner  believes  that  a  compatible  second  route  can  be  (easily)  found,  the  rough 
plan  up  to  the  transfer  event  is  then  developed  Tor  the  second  robot.  At  this 
stage,  the  rough  plan  (P2  to  A)  is  evaluated  to  see  whether  the  lengths  of  the 
routes  for  the  two  robots  are  equivalent  in  time.  If  they  are  equivalent,  this 
prompts  the  fixing  of  an  approximate  location  for  the  transfer.  If  not,  the  planner 
backs  up  to  modify  one  or  the  other  route  to  try  to  balance  the  two. 

Once  the  rough  plan  for  the  two  robots  has  been,  developed  up  to  the  transfer 
event,  the  same  set  of  steps  occurs  for  plan  development  after  the  transfer  (and 
can  be  extended  in  the  case  of  more  than  one  transfer).  Backtracking  to  a  prior 
step  of  plan  development  occurs  within  this  set  of  steps  too,  but  the  backtracking 
can  also  send  the  planner  back  to  re-consider  the  first  part  of  the  plan,  that  part 
up  to  the  transfer  point;  Note  that  the  model  is  not  dependent  upon  the  exis¬ 
tence  of  a  transfer  event.  If  a  transfer  has  been  proposed  in  LEVEL  1,  it 
provides  a  convenient  point  for  subdividing  the  planning  at  LEVEL  2.  However, 
if  no  transfer  has  been  deemed  necessary,  then  Create  Plan  P2  addresses  the 
whole  route  for  one  robot  at  a  time,  rather  than  two  route  fragments  split  at  the 
transfer. 

The  procedure  for  Create  Plan  P3  is  basically  the  same,  except  that  the  P2  plan 
is  used  as  a  basis  for  P3  and  more  detail  is  taken  into  account.  For  example,  the 
model  proposes  that  planner  works  item  by  item  in  assignment  to  robots,  and 
square  by  square  in- route  development.  The  transfer  is  specified  in  detail.  Also, 
there  can  be  an  extra  step  of  "tuning"  of  one  robot’s  workload/route  to  the  other 
by  small  adjustment  ofi  the  assignment  or.  routes.  Backtracking  in  the  case  of  an 
unacceptable  evaluation  of  the  evolving  plan  also  occurs  within  this  phase.  More 
major  backtracking  may  also  happen  if  the  planner  decides  that  P3  cannot  be 
satisfactorily  modified.  In  this  case  the-planner  goes  back  to  Level  2.to.modify  or 
re-create  P2  and  then  re-plans  at  Level  3. 

Focussing  now  on  larger  chunks  of  the  procedure,  let  us  consider  the  differences 
between  LEVEL  1,  LEVEL  2  and  LEVEL  3  PLAN  CREATION.  One  differ¬ 
ence  is  simply  the  degree  of  detail- of  information  exploited  in  plaiuiing  at  the 
different  levels;  the  least  detail  is  used  at  LEVEL  1  and  the  most  at  LEVEL  3. 
However,  by  LEVEL  3  the  plan  is  already  partially  structured  by  virtue  of  work 
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at  previous  levels  of  planning,  and  the  plan  itself  has  been  diidded  into  segments 
that  correspond  to  steps  in  the  procedure.  So  the  planner  is  dealing  with 
approximately  thei^same.  amount  of  planning  information  in' eachvstep.  There  is 
another  difference  -pertaining  to  the  mature;  of  the  information  during  the 
Orientation*  and.  Adopt;  Strategy 'steps.  In-LEVEL  1,  an  efficient.procedure -calls 
for  a  focussing.  primarily  on  a  plan  that -satisfies  the  basket  rules;  they  have 'the 
highest-  priority,  since  they;  must  not  be  violated.  In  the  next'  level,  LEVEL  2; 
efficient  planning  focuses  on  ensuring  pickup  of  all  items  (whilst  not  violating  the 
rules).  In  the  last  level  of  planning  (P3),  attention  can  be  given  to  optimizing  the 
routes  of  the  two  robots  in  a,n  attempt  to  minimize  the  number  of  store  clock 
ticks  meeded.  This  is  the  least  critical  of -alLthe  problem,  requirements,  since  no 
absolute  "standard"  in  this  regard  is  given  in  the  problem  statement. 

Finally,  it  is  possible  for  the  procedure  to  be  short-circuited  from  either  LEVEL 
1  or  LEVEL  2  PLAN  CREATION  if  the  planner  feels  that  enough  plan  detail 
exists  for  satisfactory  execution.  If  planning  is  terminated  after  LEVEL  2,  the 
planner  may  go  to  a  short  phase  of  POSTPLAN,  for  rough  consolidation  of  the 
plan.  However,  if  the  planning  is  terminated  after  LEVEL  1,  the  planner  cannot 
do  a  review,  because  the  plan  has  .  not  been  annotated  in  enough  detail  to  be 
checked. 

The  form  of  the  model  suggests  that  planning  in  this  task  is  a  linear  procedure 
that  is  carried  out  neatly  step-by-step.  In  some  cases  (e.g.,  for  experienced 
planners,  for  relatively  easy  problems)  this  may  be  true.  In  most  planning, 
though,  we  expect  that  there  will  be  at  least  some  backtracking,  as  the  planner 
discovers  that  previously  developed  parts  of  the  plan  need  to  be  modified.  In 
principle,  backtracking  from  any  step  to  any  other  step  could  occur.  We  expect, 
however,  that  certain  backtracking  pathways  are  more  frequently  followed.  TTiese 
have  yet  to  be  determined.  Of  even  greater  interest  are  cases  in  which  backtrack¬ 
ing  in  the  procedure  occurs  because  of  cognitive  overload.  For  example,  the 
planner  may  foiget  an  earlier  plan  fragment  and  need  to  go  back  to  re-create  it; 
or  the  planner  may  make  an  error  in  planning  that  causes  backtracking. 

The  model  provides  a  basis  for  further  study  of  this  planning  problem.  In  future 
experiments  we  will  test  the  model  against  subjects’  planning  procedures,  with 
the  focus  particularly  on  comparing  early  planning  procedures  with  those 
adopted  later  in  a  sequence.  Special  attention  will  be  given  to  the  conditions 
under  which  backtracking  occurs. 
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5  CONCLUSIONS 

The  SPLITS  ^planning  problem  and  paradigm  of  plan/execute  .  enabled  us  to 
evokes  human  planning  behavior  in- a- controlled  way  and.  capture  it  oii  videotape. 
From  the  verbal  aiid  graphical  'protocols  we  were  able  to  identify  a  set  of 
primitive  planning  concepts  and  actions  used  by  planners -in  carrying  out  the 
planning  task.  A  method  for  coding,  protocols,  was  also  developed;  this  scheine 
will  be  used- in  the  analysis  of  future  experiments. 

Observations  of  planners’  behavior  in  this  study  indicated  that  plans  were 
developed  in.  an  evolutionary  manher.  Planners  discovered  and  refilled  methods 
for  organizing  the-  information  and  procedures  for  manipulating  it  during  the 
course  of  the  sessions.  Furthermore,  planners  attended  to  different  levels  of 
detail  of  information  in  planning,  and  used  a  variety  of  planning  strategies. 
Planners  usually  planned  to  a  level  of  detail  sufficient  for  execution,  although 
there  were  several  instances  of  replanning. 

A  hierarchical  model  for  efficient  planning  for  this  task  has  been  developed.  The 
model  proposes  that  planning  is  executed  in  a  top-down  manner  with  the  planner 
focussing  on  increasingly  detailed  objects  and  concepts  as  planning  proceeds.  A 
future  experiment  will  test  the  model  to  determine  the  degree  to  which  human 
planning  behavior  conforms  to  this  hierarchical  approach. 
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4,  5.  Hoofd  Wetetischappelijk  Onderzoek  KLu 

Hoofd  Wetenschappelijk  Onderzoek  KM 

6.  { 

Plv.  Hoofd  Wetenschappelijk  Onderzoek  KM 

7,  8,  9.  Hoofd  van  het  Wetensch.  en  Techn.  Doc.-  en  Inform. 

Centrum  voor  de  Krijgsmacht 

10.  Dr.  D.G.  Pearce,  Defence  and  Civil  Institute  of  Environmental 
Medicine,  North  York,  Ontario,  Canada 

11.  Dr.  J.J.  Fallesen,  ARI  Field  Unit  Leavenworth,  Ft.  Leavenworth, 
Kansas,  USA 


Extra  exemplaren  van  dit  rapport  kunnen  worden  aan- 
gevraagd  door  tussenkomst  van  de  HWOs  of  de  DWOO. 


